Sep 17 16:56:02 devstack cinder-volume[74910]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 16:56:02 devstack cinder-volume[74910]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 16:56:02 devstack cinder-volume[74910]: we strongly recommend against using it for new projects. Sep 17 16:56:02 devstack cinder-volume[74910]: If you are already using Eventlet, we recommend migrating to a different Sep 17 16:56:02 devstack cinder-volume[74910]: framework. For more detail see Sep 17 16:56:02 devstack cinder-volume[74910]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 16:56:02 devstack cinder-volume[74910]: import eventlet # noqa Sep 17 16:56:04 devstack cinder-volume[74910]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 16:56:04 devstack cinder-volume[74910]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 16:56:04 devstack cinder-volume[74910]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 16:56:05 devstack cinder-volume[74910]: INFO dbcounter [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Registered counter for database cinder Sep 17 16:56:05 devstack cinder-volume[74910]: DEBUG oslo_db.sqlalchemy.engines [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 16:56:06 devstack cinder-volume[74910]: DEBUG dbcounter [-] [74910] Writer thread running {{(pid=74910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 16:56:06 devstack cinder-volume[74910]: INFO cinder.rpc [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 16:56:06 devstack cinder-volume[74910]: INFO cinder.rpc [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 16:56:06 devstack cinder-volume[74910]: DEBUG oslo_db.sqlalchemy.engines [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 16:56:06 devstack cinder-volume[74910]: INFO cinder.volume.manager [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Determined volume DB was empty at startup. Sep 17 16:56:06 devstack cinder-volume[74910]: DEBUG cinder.volume.manager [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74910) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 16:56:06 devstack cinder-volume[74910]: INFO cinder.volume.manager [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 16:56:06 devstack cinder-volume[74910]: WARNING stevedore.named [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 16:56:06 devstack cinder-volume[74910]: WARNING castellan.key_manager [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 16:56:06 devstack cinder-volume[74910]: WARNING cinder.keymgr.conf_key_mgr [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 16:56:06 devstack cinder-volume[74910]: DEBUG cinder.volume.drivers.lvm [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74910) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 17 16:56:06 devstack cinder-volume[74910]: DEBUG oslo_concurrency.processutils [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_concurrency.processutils [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] CMD "cinder-rtstool verify" returned: 0 in 0.520s {{(pid=74910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_db.sqlalchemy.engines [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 16:56:07 devstack cinder-volume[74910]: INFO cinder.rpc [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 17 16:56:07 devstack cinder-volume[74910]: INFO cinder.rpc [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 17 16:56:07 devstack cinder-volume[74910]: WARNING stevedore.named [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 16:56:07 devstack cinder-volume[74910]: WARNING castellan.key_manager [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 16:56:07 devstack cinder-volume[74910]: INFO cinder.volume.manager [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_db.sqlalchemy.engines [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 16:56:07 devstack cinder-volume[74910]: INFO oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Starting 1 workers Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Started child 75065 {{(pid=74910) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Full set of CONF: {{(pid=74910) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] ******************************************************************************** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Configuration options gathered from: {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] ================================================================================ {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 16:56:07 devstack cinder-volume[75065]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] allow_availability_zone_fallback = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] allow_compression_on_image_upload = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] allowed_direct_url_schemes = [] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] api_rate_limit = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] auth_strategy = keystone {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] az_cache_duration = 3600 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_availability_zone = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_host = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_name = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_stats_polling_interval = 60 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backup_api_class = cinder.backup.api.API {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backup_name_template = backup-%s {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backup_use_same_host = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backup_use_temp_snapshot = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] chap_password = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] chap_username = {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cinder_internal_tenant_project_id = 74433b610fe642108e8e41b427d31f81 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cinder_internal_tenant_user_id = c688ae1981e74fbdbb03ab5d3002e1fa {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cloned_volume_same_az = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cluster = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] compression_format = gzip {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] compute_api_class = cinder.compute.nova.API {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] config_dir = [] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] config_source = [] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] control_exchange = openstack {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] debug = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] default_availability_zone = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] default_group_type = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] default_volume_type = lvmdriver-1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] disk_geometry = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] driver_client_cert = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] driver_client_cert_key = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] driver_data_namespace = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] driver_ssl_cert_path = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] driver_ssl_cert_verify = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] driver_use_ssl = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] enable_force_upload = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] enable_new_services = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] enable_unsupported_driver = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] enforce_multipath_for_image_xfer = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] filter_function = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance_api_insecure = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance_api_servers = ['http://192.168.122.75/image'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance_api_ssl_compression = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance_ca_certificates_file = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance_catalog_info = image:glance:publicURL {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[75065]: INFO cinder.volume.manager [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance_certfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance_keyfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance_num_retries = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance_request_timeout = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] goodness_function = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] graceful_shutdown_timeout = 5 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] group_api_class = cinder.group.api.API {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] host = devstack {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] image_compress_on_upload = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] image_conversion_address_space_limit = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] image_conversion_cpu_limit = 60 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] image_conversion_disable = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] image_upload_use_cinder_backend = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] image_upload_use_internal_tenant = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] image_volume_cache_enabled = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] image_volume_cache_max_count = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] image_volume_cache_max_size_gb = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] init_host_max_objects_retrieval = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] instance_format = [instance: %(uuid)s] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] iscsi_target_flags = {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] iscsi_write_cache = on {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] iser_helper = tgtadm {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] iser_ip_address = 192.168.122.75 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] iser_port = 3260 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] log_color = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] log_config_append = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] log_dir = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] log_file = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] log_options = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] log_rotate_interval = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] log_rotate_interval_type = days {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] log_rotation_type = none {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] max_age = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] max_logfile_count = 30 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] max_logfile_size_mb = 200 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] max_over_subscription_ratio = 20.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] message_reap_interval = 86400 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] message_ttl = 2592000 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] migration_create_volume_timeout_secs = 300 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] monkey_patch = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] monkey_patch_modules = [] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] my_ip = 192.168.122.75 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] no_snapshot_gb_quota = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] num_iser_scan_tries = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] num_shell_tries = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] num_volume_device_scan_tries = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] nvmeof_conn_info_version = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] nvmet_ns_id = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] nvmet_port_id = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] osapi_max_limit = 1000 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] osapi_volume_ext_list = [] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] osapi_volume_listen_port = 8776 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] osapi_volume_use_ssl = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] osapi_volume_workers = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] per_volume_size_limit = -1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] periodic_fuzzy_delay = 60 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] periodic_interval = 60 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] public_endpoint = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] publish_errors = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] quota_backup_gigabytes = 1000 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] quota_backups = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] quota_gigabytes = 1000 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] quota_groups = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] quota_snapshots = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] quota_volumes = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] rate_limit_burst = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] rate_limit_except_level = CRITICAL {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] rate_limit_interval = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] reinit_driver_count = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] replication_device = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] report_discard_supported = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] report_interval = 120 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] reservation_clean_interval = 86400 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] reservation_expire = 86400 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] reserved_image_namespaces = [] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] reserved_percentage = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] rpc_response_timeout = 120 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] run_external_periodic_tasks = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] scst_target_driver = iscsi {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] scst_target_iqn_name = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_down_time = 720 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] shell_completion = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] snapshot_name_template = snapshot-%s {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] snapshot_same_host = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] split_loggers = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] state_path = /opt/stack/data/cinder {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] storage_availability_zone = nova {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] storage_protocol = iSCSI {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] syslog_log_facility = LOG_USER {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] target_helper = lioadm {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] target_ip_address = 192.168.122.75 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] target_port = 3260 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] target_protocol = iscsi {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] target_secondary_ip_addresses = [] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] trace_flags = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] transport_url = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] until_refresh = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] use_chap_auth = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] use_default_quota_class = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] use_journal = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] use_json = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] use_multipath_for_image_xfer = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] use_stderr = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] use_syslog = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] verify_glance_signatures = enabled {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_api_class = cinder.volume.api.API {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_backend_name = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_clear = zero {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_clear_ionice = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_clear_size = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_copy_bps_limit = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_dd_blocksize = 1M {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_name_template = volume-%s {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_service_inithost_offload = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volume_usage_audit_period = month {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] zoning_mode = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_concurrency.disable_process_locking = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.auth_section = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.auth_type = password {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.auth_version = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.cache = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.certfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.include_service_catalog = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.insecure = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.interface = public {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.keyfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_password = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcache_username = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.region_name = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.service_type = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.75/identity {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.backend = dogpile.cache.null {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.backend_argument = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.backend_expiration_time = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.config_prefix = cache.oslo {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.debug_cache_backend = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.enable_retry_client = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.enable_socket_keepalive = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.enabled = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.expiration_time = 600 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.hashclient_retry_attempts = 2 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.memcache_dead_retry = 300 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.memcache_pool_maxsize = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.memcache_sasl_enabled = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.password = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.proxies = [] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.redis_db = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.redis_server = localhost:6379 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.retry_attempts = 2 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.retry_delay = 0.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.socket_keepalive_count = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.socket_keepalive_idle = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.socket_keepalive_interval = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.socket_timeout = 1.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.tls_allowed_ciphers = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.tls_cafile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.tls_certfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.tls_enabled = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.tls_keyfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cache.username = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] coordination.backend_url = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.asyncio_connection = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.asyncio_slave_connection = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.backend = sqlalchemy {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.connection = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.connection_debug = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.connection_parameters = {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.connection_recycle_time = 3600 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.connection_trace = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.db_inc_retry_interval = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.db_max_retries = 20 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.db_max_retry_interval = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.db_retry_interval = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.max_overflow = 50 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.max_pool_size = 5 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.max_retries = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.mysql_wsrep_sync_wait = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.pool_timeout = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.retry_interval = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.slave_connection = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.sqlite_synchronous = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.synchronous_reader = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] database.use_db_reconnect = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_tracing.insecure = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.connection_string = messaging:// {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.enabled = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.es_doc_type = notification {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.es_scroll_size = 10000 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.es_scroll_time = 2m {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.filter_error_trace = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.hmac_keys = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.sentinel_service_name = mymaster {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.socket_timeout = 0.1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.trace_requests = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler.trace_sqlalchemy = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler_jaeger.process_tags = {} {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler_jaeger.service_name_prefix = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] profiler_otlp.service_name_prefix = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_policy.enforce_new_defaults = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_policy.policy_default_rule = default {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_policy.policy_file = policy.yaml {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] privsep_osbrick.group = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] privsep_osbrick.helper_command = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] privsep_osbrick.user = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cinder_sys_admin.group = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cinder_sys_admin.helper_command = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] cinder_sys_admin.user = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.auth_section = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.auth_type = password {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.cafile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.certfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.collect_timing = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.insecure = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.keyfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.send_service_user_token = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.split_loggers = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.timeout = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.tls_ciphers = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] service_user.tls_min_version = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.auth_section = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.auth_type = password {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.certfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.collect_timing = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.insecure = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.keyfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.region_name = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.split_loggers = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.timeout = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.tls_ciphers = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] glance.tls_min_version = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.backend_availability_zone = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.chap_password = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.chap_username = {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.disk_geometry = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.driver_client_cert = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.driver_client_cert_key = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.driver_data_namespace = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.driver_use_ssl = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.extra_capabilities = {} {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.filter_function = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.goodness_function = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.iscsi_target_flags = {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.iscsi_write_cache = on {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.iser_helper = tgtadm {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.iser_ip_address = 192.168.122.75 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.iser_port = 3260 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.lvm_share_target = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.lvm_type = auto {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.num_shell_tries = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.replication_device = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.report_discard_supported = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.reserved_percentage = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.target_helper = tgtadm {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.target_ip_address = 192.168.122.75 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.target_port = 3260 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.target_protocol = iscsi {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.trace_flags = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.unique_fqdn_network = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.use_chap_auth = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.volume_backend_name = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.volume_clear = zero {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.volume_clear_ionice = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.volume_clear_size = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack sudo[75069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack sudo[75069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_reports.file_event_handler = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_reports.log_dir = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.backend_host = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.chap_password = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.chap_username = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.disk_geometry = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.driver_client_cert = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.extra_capabilities = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.filter_function = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.goodness_function = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.iser_helper = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.iser_ip_address = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.iser_port = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.lvm_share_target = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.lvm_type = auto {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.num_shell_tries = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.replication_device = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.report_discard_supported = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.reserved_percentage = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.scst_target_driver = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.storage_protocol = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.target_helper = lioadm {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.target_ip_address = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.target_port = 3260 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.trace_flags = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.use_chap_auth = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.volume_clear = zero {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.volume_clear_size = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] lvmdriver-1.volumes_dir = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.ssl = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_notifications.driver = [] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_notifications.retry = -1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] key_manager.fixed_key = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.barbican_api_version = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.barbican_endpoint = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.barbican_endpoint_type = public {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.barbican_region_name = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.cafile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.certfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.collect_timing = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.insecure = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.keyfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.number_of_retries = 60 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.retry_delay = 1 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.send_service_user_token = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.split_loggers = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.timeout = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.tls_ciphers = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.tls_min_version = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.verify_ssl = True {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican.verify_ssl_path = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.auth_section = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.auth_type = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.cafile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.certfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.collect_timing = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.insecure = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.keyfile = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.split_loggers = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.timeout = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.tls_ciphers = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] barbican_service_user.tls_min_version = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.approle_role_id = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.approle_secret_id = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.auth_method = approle {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.auth_path = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.kv_mountpoint = secret {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.kv_path = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.kv_version = 2 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.namespace = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.root_token_id = **** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.ssl_ca_crt_file = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.timeout = 60.0 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.token_file = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.token_role = None {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.use_ssl = False {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 16:56:07 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] ******************************************************************************** {{(pid=74910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 16:56:07 devstack sudo[75069]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:07 devstack sudo[75072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:56:07 devstack sudo[75072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:07 devstack sudo[75072]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.256s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 16:56:07 devstack cinder-volume[75065]: INFO cinder.brick.local_dev.lvm [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:07 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:08 devstack sudo[75163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 16:56:08 devstack sudo[75163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:08 devstack sudo[75163]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:08 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:08 devstack cinder-volume[75065]: DEBUG cinder.brick.local_dev.lvm [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75065) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 17 16:56:08 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:08 devstack sudo[75265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:56:08 devstack sudo[75265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:08 devstack sudo[75265]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:08 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:08 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:08 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:08 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:08 devstack sudo[75498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:56:08 devstack sudo[75498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:09 devstack sudo[75498]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:09 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:09 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:09 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:09 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:09 devstack sudo[75587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 17 16:56:09 devstack sudo[75587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:09 devstack sudo[75587]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:09 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.288s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:09 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:09 devstack sudo[75672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 16:56:09 devstack sudo[75672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:09 devstack sudo[75672]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:09 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:09 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:09 devstack sudo[75713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 16:56:09 devstack sudo[75713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:10 devstack sudo[75713]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:10 devstack sudo[75737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:56:10 devstack sudo[75737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:10 devstack sudo[75737]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:10 devstack sudo[75800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:56:10 devstack sudo[75800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:10 devstack sudo[75800]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:10 devstack sudo[75816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:56:10 devstack sudo[75816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:10 devstack sudo[75816]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:10 devstack cinder-volume[75065]: INFO cinder.volume.drivers.lvm [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:10 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:10 devstack sudo[75900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:56:10 devstack sudo[75900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:11 devstack sudo[75900]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:11 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:11 devstack cinder-volume[75065]: DEBUG cinder.volume.drivers.lvm [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Updating volume stats {{(pid=75065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 16:56:11 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:11 devstack sudo[75903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 16:56:11 devstack sudo[75903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:11 devstack sudo[75903]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:11 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:11 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:11 devstack sudo[75906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:56:11 devstack sudo[75906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:11 devstack sudo[75906]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:11 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:11 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:11 devstack sudo[75909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:56:11 devstack sudo[75909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:12 devstack sudo[75909]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:12 devstack sudo[75914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:56:12 devstack sudo[75914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:12 devstack sudo[75914]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:12 devstack cinder-volume[75065]: INFO cinder.volume.driver [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Driver hasn't implemented _init_vendor_properties() Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG cinder.volume.driver [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75065) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG oslo_db.sqlalchemy.engines [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75065) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG dbcounter [-] [75065] Writer thread running {{(pid=75065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG cinder.db.api [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Building query based on filter {{(pid=75065) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG cinder.image.image_utils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75065) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 17 16:56:12 devstack cinder-volume[75065]: INFO cinder.keymgr.migration [None req-d59e05d8-039b-4c9a-93a7-d776e2f4aa49 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG cinder.volume.drivers.lvm [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Updating volume stats {{(pid=75065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:12 devstack sudo[75918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 16:56:12 devstack sudo[75918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:12 devstack sudo[75918]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:12 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:12 devstack sudo[75921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:56:12 devstack sudo[75921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:13 devstack sudo[75921]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:13 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:13 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:13 devstack sudo[75926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:56:13 devstack sudo[75926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:13 devstack sudo[75926]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:13 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:13 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:13 devstack sudo[75929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:56:13 devstack sudo[75929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:13 devstack sudo[75929]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:13 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:13 devstack cinder-volume[75065]: DEBUG cinder.manager [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Notifying Schedulers of capabilities ... {{(pid=75065) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 16:56:13 devstack cinder-volume[75065]: INFO cinder.volume.manager [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Driver initialization completed successfully. Sep 17 16:56:13 devstack cinder-volume[75065]: INFO cinder.manager [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Initiating service 2 cleanup Sep 17 16:56:13 devstack cinder-volume[75065]: INFO cinder.manager [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Service 2 cleanup completed. Sep 17 16:56:13 devstack cinder-volume[75065]: DEBUG cinder.service [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Creating RPC server for service cinder-volume {{(pid=75065) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 16:56:13 devstack cinder-volume[75065]: DEBUG cinder.service [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75065) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 16:56:13 devstack cinder-volume[75065]: INFO cinder.volume.manager [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 17 16:56:13 devstack cinder-volume[75065]: DEBUG cinder.volume.drivers.lvm [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Updating volume stats {{(pid=75065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 16:56:13 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:13 devstack sudo[75935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 16:56:13 devstack sudo[75935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:14 devstack sudo[75935]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:14 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:14 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:14 devstack sudo[75940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:56:14 devstack sudo[75940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:14 devstack sudo[75940]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:14 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:14 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:14 devstack sudo[75943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:56:14 devstack sudo[75943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:14 devstack sudo[75943]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:14 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:14 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:56:14 devstack sudo[75946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:56:14 devstack sudo[75946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:56:14 devstack sudo[75946]: pam_unix(sudo:session): session closed for user root Sep 17 16:56:14 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:56:14 devstack cinder-volume[75065]: INFO cinder.volume.manager [None req-24afcb26-d02d-420f-9772-c600c65f029b None None] Driver post RPC initialization completed successfully. Sep 17 16:56:17 devstack cinder-volume[74910]: DEBUG dbcounter [-] [74910] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 16:56:18 devstack cinder-volume[75065]: DEBUG oslo_service.periodic_task [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running periodic task VolumeManager._thread_info {{(pid=75065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 16:56:18 devstack cinder-volume[75065]: DEBUG cinder.volume.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] thread count: 6 {{(pid=75065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 16:56:18 devstack cinder-volume[75065]: DEBUG cinder.volume.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] thread info: [<_MainThread(MainThread, started 134887074308224)>, , , , , ] {{(pid=75065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 16:56:24 devstack cinder-volume[75065]: DEBUG dbcounter [-] [75065] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 16:56:24 devstack cinder-volume[75065]: DEBUG dbcounter [-] [75065] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 16:57:18 devstack cinder-volume[75065]: DEBUG oslo_service.periodic_task [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 16:57:18 devstack cinder-volume[75065]: DEBUG cinder.volume.drivers.lvm [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Updating volume stats {{(pid=75065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 16:57:18 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:57:18 devstack sudo[77998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 16:57:18 devstack sudo[77998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:57:19 devstack sudo[77998]: pam_unix(sudo:session): session closed for user root Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:57:19 devstack sudo[78001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:57:19 devstack sudo[78001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:57:19 devstack sudo[78001]: pam_unix(sudo:session): session closed for user root Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:57:19 devstack sudo[78004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:57:19 devstack sudo[78004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:57:19 devstack sudo[78004]: pam_unix(sudo:session): session closed for user root Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:57:19 devstack sudo[78007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:57:19 devstack sudo[78007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:57:19 devstack sudo[78007]: pam_unix(sudo:session): session closed for user root Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG cinder.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Notifying Schedulers of capabilities ... {{(pid=75065) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG oslo_service.periodic_task [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running periodic task VolumeManager._thread_info {{(pid=75065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG cinder.volume.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] thread count: 6 {{(pid=75065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 16:57:19 devstack cinder-volume[75065]: DEBUG cinder.volume.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] thread info: [<_MainThread(MainThread, started 134887074308224)>, , , , , ] {{(pid=75065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 16:58:18 devstack cinder-volume[75065]: DEBUG oslo_service.periodic_task [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 16:58:18 devstack cinder-volume[75065]: DEBUG cinder.volume.drivers.lvm [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Updating volume stats {{(pid=75065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 16:58:18 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:58:18 devstack sudo[81360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 16:58:18 devstack sudo[81360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:58:19 devstack sudo[81360]: pam_unix(sudo:session): session closed for user root Sep 17 16:58:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:58:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:58:19 devstack sudo[81366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:58:19 devstack sudo[81366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:58:19 devstack sudo[81366]: pam_unix(sudo:session): session closed for user root Sep 17 16:58:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:58:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:58:19 devstack sudo[81370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:58:19 devstack sudo[81370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:58:19 devstack sudo[81370]: pam_unix(sudo:session): session closed for user root Sep 17 16:58:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:58:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:58:19 devstack sudo[81377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:58:19 devstack sudo[81377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:58:20 devstack sudo[81377]: pam_unix(sudo:session): session closed for user root Sep 17 16:58:20 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:58:20 devstack cinder-volume[75065]: DEBUG cinder.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Notifying Schedulers of capabilities ... {{(pid=75065) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 16:58:20 devstack cinder-volume[75065]: DEBUG oslo_service.periodic_task [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running periodic task VolumeManager._thread_info {{(pid=75065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 16:58:20 devstack cinder-volume[75065]: DEBUG cinder.volume.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] thread count: 6 {{(pid=75065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 16:58:20 devstack cinder-volume[75065]: DEBUG cinder.volume.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] thread info: [<_MainThread(MainThread, started 134887074308224)>, , , , , ] {{(pid=75065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 16:58:24 devstack cinder-volume[75065]: DEBUG dbcounter [-] [75065] Writing DB stats cinder:SELECT=1 {{(pid=75065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 16:58:24 devstack cinder-volume[75065]: DEBUG dbcounter [-] [75065] Writing DB stats cinder:UPDATE=1 {{(pid=75065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 16:59:18 devstack cinder-volume[75065]: DEBUG oslo_service.periodic_task [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 16:59:18 devstack cinder-volume[75065]: DEBUG cinder.volume.drivers.lvm [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Updating volume stats {{(pid=75065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 16:59:18 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:59:18 devstack sudo[83430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 16:59:18 devstack sudo[83430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:59:19 devstack sudo[83430]: pam_unix(sudo:session): session closed for user root Sep 17 16:59:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:59:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:59:19 devstack sudo[83438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:59:19 devstack sudo[83438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:59:19 devstack sudo[83438]: pam_unix(sudo:session): session closed for user root Sep 17 16:59:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:59:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:59:19 devstack sudo[83442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 16:59:19 devstack sudo[83442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:59:19 devstack sudo[83442]: pam_unix(sudo:session): session closed for user root Sep 17 16:59:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:59:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 16:59:19 devstack sudo[83445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 16:59:19 devstack sudo[83445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 16:59:20 devstack sudo[83445]: pam_unix(sudo:session): session closed for user root Sep 17 16:59:20 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 16:59:20 devstack cinder-volume[75065]: DEBUG cinder.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Notifying Schedulers of capabilities ... {{(pid=75065) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 16:59:20 devstack cinder-volume[75065]: DEBUG oslo_service.periodic_task [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running periodic task VolumeManager._thread_info {{(pid=75065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 16:59:20 devstack cinder-volume[75065]: DEBUG cinder.volume.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] thread count: 6 {{(pid=75065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 16:59:20 devstack cinder-volume[75065]: DEBUG cinder.volume.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] thread info: [<_MainThread(MainThread, started 134887074308224)>, , , , , ] {{(pid=75065) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:00:18 devstack cinder-volume[75065]: DEBUG oslo_service.periodic_task [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75065) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:00:18 devstack cinder-volume[75065]: DEBUG cinder.volume.drivers.lvm [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Updating volume stats {{(pid=75065) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 17:00:18 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:18 devstack sudo[84628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 17:00:18 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:19 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:19 devstack sudo[84631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 17:00:19 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:19 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:19 devstack sudo[84645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 17:00:19 devstack sudo[84645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:19 devstack sudo[84645]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:19 devstack sudo[84648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 17:00:19 devstack sudo[84648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:19 devstack sudo[84648]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:19 devstack cinder-volume[75065]: DEBUG oslo_concurrency.processutils [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75065) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:19 devstack cinder-volume[75065]: DEBUG cinder.manager [None req-38b6e1e4-3125-4885-97f2-aa3e20869951 None None] Notifying Schedulers of capabilities ... {{(pid=75065) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:00:24 devstack cinder-volume[75065]: DEBUG dbcounter [-] [75065] Writing DB stats cinder:SELECT=1 {{(pid=75065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:00:24 devstack cinder-volume[75065]: DEBUG dbcounter [-] [75065] Writing DB stats cinder:UPDATE=1 {{(pid=75065) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:00:34 devstack cinder-volume[74910]: INFO oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Caught SIGTERM, stopping children Sep 17 17:00:34 devstack cinder-volume[74910]: DEBUG oslo_concurrency.lockutils [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Acquiring lock "singleton_lock" {{(pid=74910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 17:00:34 devstack cinder-volume[74910]: DEBUG oslo_concurrency.lockutils [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Acquired lock "singleton_lock" {{(pid=74910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 17:00:34 devstack cinder-volume[74910]: DEBUG oslo_concurrency.lockutils [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Releasing lock "singleton_lock" {{(pid=74910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 17:00:34 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Stop services. {{(pid=74910) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 17:00:34 devstack cinder-volume[74910]: DEBUG oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Killing children. {{(pid=74910) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 17:00:34 devstack cinder-volume[74910]: INFO oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Waiting on 1 children to exit Sep 17 17:00:38 devstack cinder-volume[75065]: DEBUG oslo_concurrency.lockutils [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Acquiring lock "singleton_lock" {{(pid=75065) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 17:00:38 devstack cinder-volume[75065]: DEBUG oslo_concurrency.lockutils [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Acquired lock "singleton_lock" {{(pid=75065) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 17:00:38 devstack cinder-volume[75065]: DEBUG oslo_concurrency.lockutils [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Releasing lock "singleton_lock" {{(pid=75065) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 17:00:38 devstack cinder-volume[75065]: WARNING amqp [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 17:00:38 devstack cinder-volume[75065]: WARNING amqp [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 17:00:38 devstack cinder-volume[74910]: INFO oslo_service.backend._eventlet.service [None req-a30076a9-1f12-4c5e-94f1-a8cf8affa572 None None] Child 75065 exited with status 0 Sep 17 17:00:39 devstack cinder-volume[85092]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 17:00:39 devstack cinder-volume[85092]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 17:00:39 devstack cinder-volume[85092]: we strongly recommend against using it for new projects. Sep 17 17:00:39 devstack cinder-volume[85092]: If you are already using Eventlet, we recommend migrating to a different Sep 17 17:00:39 devstack cinder-volume[85092]: framework. For more detail see Sep 17 17:00:39 devstack cinder-volume[85092]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 17:00:39 devstack cinder-volume[85092]: import eventlet # noqa Sep 17 17:00:41 devstack cinder-volume[85092]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 17:00:41 devstack cinder-volume[85092]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 17:00:41 devstack cinder-volume[85092]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 17:00:41 devstack cinder-volume[85092]: INFO dbcounter [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Registered counter for database cinder Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_db.sqlalchemy.engines [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG dbcounter [-] [85092] Writer thread running {{(pid=85092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 17:00:42 devstack cinder-volume[85092]: INFO cinder.rpc [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 17:00:42 devstack cinder-volume[85092]: INFO cinder.rpc [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_db.sqlalchemy.engines [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 17:00:42 devstack cinder-volume[85092]: INFO cinder.volume.manager [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Determined volume DB was empty at startup. Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG cinder.volume.manager [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85092) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 17:00:42 devstack cinder-volume[85092]: INFO cinder.volume.manager [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 17:00:42 devstack cinder-volume[85092]: WARNING stevedore.named [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 17:00:42 devstack cinder-volume[85092]: WARNING castellan.key_manager [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 17:00:42 devstack cinder-volume[85092]: WARNING cinder.keymgr.conf_key_mgr [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 17:00:42 devstack cinder-volume[85092]: INFO cinder.volume.manager [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_db.sqlalchemy.engines [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 17:00:42 devstack cinder-volume[85092]: INFO oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Starting 1 workers Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Started child 85310 {{(pid=85092) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Full set of CONF: {{(pid=85092) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] ******************************************************************************** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Configuration options gathered from: {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] ================================================================================ {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] allow_availability_zone_fallback = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] allow_compression_on_image_upload = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] allowed_direct_url_schemes = [] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] api_rate_limit = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] auth_strategy = keystone {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_availability_zone = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_host = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_name = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_stats_polling_interval = 60 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backup_api_class = cinder.backup.api.API {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backup_name_template = backup-%s {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85310]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backup_use_same_host = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backup_use_temp_snapshot = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] chap_password = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] chap_username = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cinder_internal_tenant_project_id = 74433b610fe642108e8e41b427d31f81 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cinder_internal_tenant_user_id = c688ae1981e74fbdbb03ab5d3002e1fa {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cluster = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] compression_format = gzip {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] compute_api_class = cinder.compute.nova.API {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] config_dir = [] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] config_source = [] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] control_exchange = openstack {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] debug = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] default_availability_zone = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] default_group_type = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] default_volume_type = QuobyteHD {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] disk_geometry = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] driver_client_cert = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] driver_client_cert_key = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] driver_data_namespace = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] driver_ssl_cert_path = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] driver_ssl_cert_verify = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] driver_use_ssl = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] enable_new_services = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] enable_unsupported_driver = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] enabled_backends = ['QuobyteHD'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] enforce_multipath_for_image_xfer = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] filter_function = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance_api_insecure = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance_api_servers = ['http://192.168.122.75/image'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance_api_ssl_compression = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance_ca_certificates_file = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance_catalog_info = image:glance:publicURL {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance_certfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance_keyfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance_num_retries = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance_request_timeout = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] goodness_function = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] graceful_shutdown_timeout = 5 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] group_api_class = cinder.group.api.API {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] host = devstack {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] image_compress_on_upload = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] image_conversion_address_space_limit = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] image_conversion_cpu_limit = 60 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] image_conversion_disable = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] image_upload_use_cinder_backend = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] image_upload_use_internal_tenant = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] image_volume_cache_enabled = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] image_volume_cache_max_count = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] image_volume_cache_max_size_gb = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] init_host_max_objects_retrieval = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] instance_format = [instance: %(uuid)s] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] iscsi_target_flags = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] iscsi_write_cache = on {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] iser_helper = tgtadm {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] iser_ip_address = 192.168.122.75 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] iser_port = 3260 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] log_color = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] log_config_append = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] log_dir = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] log_file = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] log_options = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] log_rotate_interval = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] log_rotate_interval_type = days {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] log_rotation_type = none {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] max_age = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] max_logfile_count = 30 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] max_logfile_size_mb = 200 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] max_over_subscription_ratio = 20.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] message_reap_interval = 86400 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] message_ttl = 2592000 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] migration_create_volume_timeout_secs = 300 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] monkey_patch = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] monkey_patch_modules = [] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] my_ip = 192.168.122.75 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] no_snapshot_gb_quota = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] num_iser_scan_tries = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] num_shell_tries = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] num_volume_device_scan_tries = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] nvmeof_conn_info_version = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] nvmet_ns_id = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] nvmet_port_id = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] osapi_max_limit = 1000 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] osapi_volume_ext_list = [] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] osapi_volume_listen_port = 8776 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] osapi_volume_use_ssl = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] osapi_volume_workers = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] per_volume_size_limit = -1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] periodic_fuzzy_delay = 60 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] periodic_interval = 60 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] public_endpoint = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] publish_errors = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] quota_backup_gigabytes = 1000 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] quota_backups = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] quota_gigabytes = 1000 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] quota_groups = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] quota_snapshots = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] quota_volumes = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] rate_limit_burst = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] rate_limit_except_level = CRITICAL {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] rate_limit_interval = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] reinit_driver_count = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] replication_device = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] report_discard_supported = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] report_interval = 120 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] reservation_clean_interval = 86400 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] reservation_expire = 86400 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] reserved_image_namespaces = [] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] reserved_percentage = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] rpc_response_timeout = 120 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] run_external_periodic_tasks = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] scst_target_driver = iscsi {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] scst_target_iqn_name = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_down_time = 720 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] shell_completion = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] snapshot_name_template = snapshot-%s {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] split_loggers = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] state_path = /opt/stack/data/cinder {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] storage_availability_zone = nova {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] storage_protocol = iSCSI {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] syslog_log_facility = LOG_USER {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] target_helper = lioadm {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] target_ip_address = 192.168.122.75 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] target_port = 3260 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] target_protocol = iscsi {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] target_secondary_ip_addresses = [] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] trace_flags = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] transport_url = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] until_refresh = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] use_chap_auth = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] use_default_quota_class = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] use_journal = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] use_json = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] use_multipath_for_image_xfer = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] use_stderr = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85310]: INFO cinder.volume.manager [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] use_syslog = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85310]: DEBUG cinder.volume.drivers.remotefs [None req-687783be-765b-424f-a122-ee959f8e5073 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85310) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] verify_glance_signatures = enabled {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_api_class = cinder.volume.api.API {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_backend_name = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_clear = zero {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_clear_ionice = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_clear_size = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_copy_bps_limit = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_dd_blocksize = 1M {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_name_template = volume-%s {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_service_inithost_offload = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volume_usage_audit_period = month {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] zoning_mode = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_concurrency.disable_process_locking = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.auth_section = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.auth_type = password {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.auth_version = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.cache = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.certfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.include_service_catalog = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.insecure = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.interface = public {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.keyfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_password = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcache_username = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.region_name = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.service_type = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.75/identity {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.backend = dogpile.cache.null {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.backend_argument = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.backend_expiration_time = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.config_prefix = cache.oslo {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.debug_cache_backend = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.enable_retry_client = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.enable_socket_keepalive = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.enabled = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.expiration_time = 600 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.hashclient_retry_attempts = 2 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.memcache_dead_retry = 300 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.memcache_pool_maxsize = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.memcache_sasl_enabled = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.password = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.proxies = [] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.redis_db = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.redis_server = localhost:6379 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.retry_attempts = 2 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.retry_delay = 0.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.socket_keepalive_count = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.socket_keepalive_idle = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.socket_keepalive_interval = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.socket_timeout = 1.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.tls_allowed_ciphers = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.tls_cafile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.tls_certfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.tls_enabled = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.tls_keyfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cache.username = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] coordination.backend_url = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.asyncio_connection = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.asyncio_slave_connection = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.backend = sqlalchemy {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.connection = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.connection_debug = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.connection_parameters = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.connection_recycle_time = 3600 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.connection_trace = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.db_inc_retry_interval = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.db_max_retries = 20 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.db_max_retry_interval = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.db_retry_interval = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.max_overflow = 50 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.max_pool_size = 5 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.max_retries = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.mysql_wsrep_sync_wait = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.pool_timeout = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.retry_interval = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.slave_connection = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.sqlite_synchronous = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.synchronous_reader = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] database.use_db_reconnect = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_tracing.insecure = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.connection_string = messaging:// {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.enabled = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.es_doc_type = notification {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.es_scroll_size = 10000 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.es_scroll_time = 2m {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.filter_error_trace = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.hmac_keys = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.sentinel_service_name = mymaster {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.socket_timeout = 0.1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.trace_requests = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler.trace_sqlalchemy = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler_jaeger.process_tags = {} {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler_jaeger.service_name_prefix = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] profiler_otlp.service_name_prefix = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_policy.enforce_new_defaults = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_policy.policy_default_rule = default {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_policy.policy_file = policy.yaml {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] privsep_osbrick.group = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] privsep_osbrick.helper_command = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] privsep_osbrick.user = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cinder_sys_admin.group = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cinder_sys_admin.helper_command = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] cinder_sys_admin.user = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.auth_section = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.auth_type = password {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.cafile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.certfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.collect_timing = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.insecure = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.keyfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.send_service_user_token = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.split_loggers = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.timeout = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.tls_ciphers = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] service_user.tls_min_version = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.auth_section = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.auth_type = password {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.certfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.collect_timing = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.insecure = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.keyfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.region_name = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.split_loggers = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.timeout = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.tls_ciphers = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] glance.tls_min_version = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.backend_availability_zone = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.chap_password = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.chap_username = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.disk_geometry = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.driver_client_cert = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.driver_client_cert_key = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.driver_data_namespace = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.driver_use_ssl = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.extra_capabilities = {} {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.filter_function = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.goodness_function = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.iscsi_target_flags = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.iscsi_write_cache = on {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.iser_helper = tgtadm {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.iser_ip_address = 192.168.122.75 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.iser_port = 3260 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nas_host = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nas_login = admin {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nas_mount_options = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nas_password = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nas_private_key = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nas_share_path = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.num_shell_tries = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.quobyte_volume_url = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.replication_device = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.report_discard_supported = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.reserved_percentage = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.target_helper = tgtadm {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.target_ip_address = 192.168.122.75 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.target_port = 3260 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.target_protocol = iscsi {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.trace_flags = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.unique_fqdn_network = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.use_chap_auth = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.volume_backend_name = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.volume_clear = zero {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.volume_clear_ionice = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.volume_clear_size = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_reports.file_event_handler = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_reports.log_dir = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.backend_availability_zone = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.backend_host = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.chap_password = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.chap_username = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.chiscsi_conf = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.disk_geometry = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.driver_client_cert = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.driver_data_namespace = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.driver_use_ssl = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.extra_capabilities = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.filter_function = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.goodness_function = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.iser_helper = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.iser_ip_address = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.iser_port = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.iser_target_prefix = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nas_host = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nas_login = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nas_mount_options = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nas_password = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nas_private_key = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nas_share_path = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nas_ssh_port = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.num_shell_tries = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.nvmet_port_id = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.replication_device = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.report_discard_supported = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.reserved_percentage = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.scst_target_driver = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.storage_protocol = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.target_helper = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.target_ip_address = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.target_port = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.target_prefix = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.target_protocol = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.trace_flags = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.use_chap_auth = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.volume_clear = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.volume_clear_size = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] QuobyteHD.volumes_dir = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.ssl = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_notifications.driver = [] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_notifications.retry = -1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] key_manager.fixed_key = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.barbican_api_version = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.barbican_endpoint = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.barbican_endpoint_type = public {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.barbican_region_name = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.cafile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.certfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.collect_timing = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.insecure = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.keyfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.number_of_retries = 60 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.retry_delay = 1 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.send_service_user_token = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.split_loggers = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.timeout = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.tls_ciphers = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.tls_min_version = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.verify_ssl = True {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican.verify_ssl_path = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.auth_section = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.auth_type = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.cafile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.certfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.collect_timing = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.insecure = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.keyfile = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.split_loggers = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.timeout = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.tls_ciphers = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] barbican_service_user.tls_min_version = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.approle_role_id = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.approle_secret_id = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.auth_method = approle {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.auth_path = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.kv_mountpoint = secret {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.kv_path = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.kv_version = 2 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.namespace = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.root_token_id = **** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.ssl_ca_crt_file = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.timeout = 60.0 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.token_file = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.token_role = None {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.use_ssl = False {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:42 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:43 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] ******************************************************************************** {{(pid=85092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85310) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 17:00:43 devstack cinder-volume[85310]: WARNING cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 17:00:43 devstack cinder-volume[85310]: WARNING cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.processutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Running cmd (subprocess): mount.quobyte {{(pid=85310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:43 devstack quobyte-client[85315]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 17:00:43 devstack quobyte-client[85315]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.processutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=85310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:00:43 devstack cinder-volume[85310]: INFO cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 ... Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.processutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 -c /etc/quobyte/client-cinder.cfg {{(pid=85310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:43 devstack sudo[85316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 -c /etc/quobyte/client-cinder.cfg Sep 17 17:00:43 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:43 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.processutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.445s {{(pid=85310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:43 devstack cinder-volume[85310]: INFO cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 succeeded Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.479s {{(pid=85310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.processutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:43 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:00:43 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:43 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.processutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.261s {{(pid=85310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:43 devstack cinder-volume[85310]: INFO cinder.volume.driver [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG cinder.volume.driver [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.800148010254, 'free_capacity_gb': 1775.800148010254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85310) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_db.sqlalchemy.engines [None req-687783be-765b-424f-a122-ee959f8e5073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG dbcounter [-] [85310] Writer thread running {{(pid=85310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG cinder.db.api [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Building query based on filter {{(pid=85310) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG cinder.image.image_utils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85310) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 17 17:00:43 devstack cinder-volume[85310]: INFO cinder.keymgr.migration [None req-cb4205d1-5393-402e-a962-fb01204c3c01 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:00:43 devstack cinder-volume[85310]: DEBUG oslo_concurrency.processutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:43 devstack sudo[85421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:00:43 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:44 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:44 devstack cinder-volume[85310]: DEBUG oslo_concurrency.processutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.274s {{(pid=85310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:44 devstack cinder-volume[85310]: DEBUG cinder.manager [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Notifying Schedulers of capabilities ... {{(pid=85310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:00:44 devstack cinder-volume[85310]: INFO cinder.volume.manager [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Driver initialization completed successfully. Sep 17 17:00:44 devstack cinder-volume[85310]: INFO cinder.manager [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Initiating service 3 cleanup Sep 17 17:00:44 devstack cinder-volume[85310]: INFO cinder.manager [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Service 3 cleanup completed. Sep 17 17:00:44 devstack cinder-volume[85310]: DEBUG cinder.service [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Creating RPC server for service cinder-volume {{(pid=85310) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 17:00:44 devstack cinder-volume[85310]: DEBUG cinder.service [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85310) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 17:00:44 devstack cinder-volume[85310]: INFO cinder.volume.manager [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 17:00:44 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:00:44 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:00:44 devstack cinder-volume[85310]: DEBUG cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:00:44 devstack cinder-volume[85310]: DEBUG cinder.volume.drivers.quobyte [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:00:44 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:00:44 devstack cinder-volume[85310]: DEBUG oslo_concurrency.processutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:44 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:00:44 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:45 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:45 devstack cinder-volume[85310]: DEBUG oslo_concurrency.processutils [None req-687783be-765b-424f-a122-ee959f8e5073 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.528s {{(pid=85310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:45 devstack cinder-volume[85310]: INFO cinder.volume.manager [None req-687783be-765b-424f-a122-ee959f8e5073 None None] Driver post RPC initialization completed successfully. Sep 17 17:00:48 devstack cinder-volume[85092]: INFO oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Caught SIGTERM, stopping children Sep 17 17:00:48 devstack cinder-volume[85092]: DEBUG oslo_concurrency.lockutils [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Acquiring lock "singleton_lock" {{(pid=85092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 17:00:48 devstack cinder-volume[85092]: DEBUG oslo_concurrency.lockutils [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Acquired lock "singleton_lock" {{(pid=85092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 17:00:48 devstack cinder-volume[85092]: DEBUG oslo_concurrency.lockutils [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Releasing lock "singleton_lock" {{(pid=85092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 17:00:48 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Stop services. {{(pid=85092) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 17:00:48 devstack cinder-volume[85092]: DEBUG oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Killing children. {{(pid=85092) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 17:00:48 devstack cinder-volume[85092]: INFO oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Waiting on 1 children to exit Sep 17 17:00:48 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Acquiring lock "singleton_lock" {{(pid=85310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 17:00:48 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Acquired lock "singleton_lock" {{(pid=85310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 17:00:48 devstack cinder-volume[85310]: DEBUG oslo_concurrency.lockutils [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Releasing lock "singleton_lock" {{(pid=85310) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 17:00:48 devstack cinder-volume[85310]: WARNING amqp [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 17:00:48 devstack cinder-volume[85310]: WARNING amqp [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 17:00:48 devstack cinder-volume[85092]: INFO oslo_service.backend._eventlet.service [None req-8e8c95c4-c8f4-403d-9d5a-6597478e6e45 None None] Child 85310 exited with status 0 Sep 17 17:00:49 devstack cinder-volume[85611]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 17:00:49 devstack cinder-volume[85611]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 17:00:49 devstack cinder-volume[85611]: we strongly recommend against using it for new projects. Sep 17 17:00:49 devstack cinder-volume[85611]: If you are already using Eventlet, we recommend migrating to a different Sep 17 17:00:49 devstack cinder-volume[85611]: framework. For more detail see Sep 17 17:00:49 devstack cinder-volume[85611]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 17:00:49 devstack cinder-volume[85611]: import eventlet # noqa Sep 17 17:00:52 devstack cinder-volume[85611]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 17:00:52 devstack cinder-volume[85611]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 17:00:52 devstack cinder-volume[85611]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 17:00:53 devstack cinder-volume[85611]: INFO dbcounter [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Registered counter for database cinder Sep 17 17:00:53 devstack cinder-volume[85611]: DEBUG oslo_db.sqlalchemy.engines [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 17:00:53 devstack cinder-volume[85611]: DEBUG dbcounter [-] [85611] Writer thread running {{(pid=85611) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 17:00:53 devstack cinder-volume[85611]: INFO cinder.rpc [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 17:00:53 devstack cinder-volume[85611]: INFO cinder.rpc [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_db.sqlalchemy.engines [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 17:00:54 devstack cinder-volume[85611]: INFO cinder.volume.manager [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Determined volume DB was empty at startup. Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG cinder.volume.manager [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85611) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 17:00:54 devstack cinder-volume[85611]: WARNING stevedore.named [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 17:00:54 devstack cinder-volume[85611]: WARNING castellan.key_manager [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 17:00:54 devstack cinder-volume[85611]: WARNING cinder.keymgr.conf_key_mgr [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 17:00:54 devstack cinder-volume[85611]: INFO cinder.volume.manager [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_db.sqlalchemy.engines [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 17:00:54 devstack cinder-volume[85611]: INFO oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Starting 1 workers Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Started child 85889 {{(pid=85611) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Full set of CONF: {{(pid=85611) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] ******************************************************************************** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] Configuration options gathered from: {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] ================================================================================ {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] allow_availability_zone_fallback = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] allow_compression_on_image_upload = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] allowed_direct_url_schemes = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] api_rate_limit = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] auth_strategy = keystone {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_availability_zone = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_host = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_stats_polling_interval = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backup_api_class = cinder.backup.api.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backup_name_template = backup-%s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backup_use_same_host = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backup_use_temp_snapshot = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] chap_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] chap_username = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cinder_internal_tenant_project_id = 74433b610fe642108e8e41b427d31f81 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85889]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cinder_internal_tenant_user_id = c688ae1981e74fbdbb03ab5d3002e1fa {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cluster = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] compression_format = gzip {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] compute_api_class = cinder.compute.nova.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] config_dir = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] config_source = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] control_exchange = openstack {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] debug = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] default_availability_zone = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] default_group_type = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] default_volume_type = QuobyteHD {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] disk_geometry = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] driver_client_cert = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] driver_client_cert_key = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] driver_data_namespace = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] driver_ssl_cert_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] driver_ssl_cert_verify = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] driver_use_ssl = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] enable_new_services = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] enable_unsupported_driver = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] enabled_backends = ['QuobyteHD'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] enforce_multipath_for_image_xfer = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] filter_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance_api_insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance_api_servers = ['http://192.168.122.75/image'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance_api_ssl_compression = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance_ca_certificates_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance_catalog_info = image:glance:publicURL {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance_certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance_keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance_num_retries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 17:00:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85889) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance_request_timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] goodness_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] graceful_shutdown_timeout = 5 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] group_api_class = cinder.group.api.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] host = devstack {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] image_compress_on_upload = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] image_conversion_address_space_limit = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] image_conversion_cpu_limit = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] image_conversion_disable = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] image_upload_use_cinder_backend = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] image_upload_use_internal_tenant = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] image_volume_cache_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] image_volume_cache_max_count = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] image_volume_cache_max_size_gb = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] init_host_max_objects_retrieval = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] instance_format = [instance: %(uuid)s] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] iscsi_target_flags = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] iscsi_write_cache = on {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] iser_helper = tgtadm {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] iser_ip_address = 192.168.122.75 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] iser_port = 3260 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] log_color = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] log_config_append = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] log_dir = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] log_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] log_options = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] log_rotate_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] log_rotate_interval_type = days {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] log_rotation_type = none {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] max_age = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] max_logfile_count = 30 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] max_logfile_size_mb = 200 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] max_over_subscription_ratio = 20.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] message_reap_interval = 86400 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] message_ttl = 2592000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] migration_create_volume_timeout_secs = 300 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] monkey_patch = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] monkey_patch_modules = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] my_ip = 192.168.122.75 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] no_snapshot_gb_quota = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] num_iser_scan_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] num_shell_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] num_volume_device_scan_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] nvmeof_conn_info_version = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] nvmet_ns_id = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] nvmet_port_id = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] osapi_max_limit = 1000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] osapi_volume_ext_list = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] osapi_volume_listen_port = 8776 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] osapi_volume_use_ssl = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] osapi_volume_workers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] per_volume_size_limit = -1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] periodic_fuzzy_delay = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] periodic_interval = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] public_endpoint = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] publish_errors = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] quota_backup_gigabytes = 1000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] quota_backups = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] quota_gigabytes = 1000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] quota_groups = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] quota_snapshots = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] quota_volumes = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] rate_limit_burst = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] rate_limit_except_level = CRITICAL {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] rate_limit_interval = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] reinit_driver_count = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] replication_device = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] report_discard_supported = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] report_interval = 120 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] reservation_clean_interval = 86400 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] reservation_expire = 86400 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] reserved_image_namespaces = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] reserved_percentage = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] rpc_response_timeout = 120 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] run_external_periodic_tasks = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] scst_target_driver = iscsi {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] scst_target_iqn_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_down_time = 720 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] shell_completion = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] snapshot_name_template = snapshot-%s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] split_loggers = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] state_path = /opt/stack/data/cinder {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] storage_availability_zone = nova {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] storage_protocol = iSCSI {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] syslog_log_facility = LOG_USER {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] target_helper = lioadm {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] target_ip_address = 192.168.122.75 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] target_port = 3260 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] target_protocol = iscsi {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] target_secondary_ip_addresses = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] trace_flags = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] transport_url = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] until_refresh = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] use_chap_auth = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] use_default_quota_class = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] use_journal = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] use_json = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] use_multipath_for_image_xfer = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] use_stderr = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] use_syslog = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] verify_glance_signatures = enabled {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_api_class = cinder.volume.api.API {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_backend_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_clear = zero {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_clear_ionice = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_clear_size = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_copy_bps_limit = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_dd_blocksize = 1M {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_name_template = volume-%s {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_service_inithost_offload = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volume_usage_audit_period = month {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] zoning_mode = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_concurrency.disable_process_locking = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.auth_section = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.auth_type = password {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.auth_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.cache = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.include_service_catalog = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.interface = public {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcache_username = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.region_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.service_type = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.75/identity {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.backend = dogpile.cache.null {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.backend_argument = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.backend_expiration_time = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.config_prefix = cache.oslo {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.debug_cache_backend = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.enable_retry_client = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.enable_socket_keepalive = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.expiration_time = 600 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.hashclient_retry_attempts = 2 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.memcache_dead_retry = 300 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.memcache_pool_maxsize = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.memcache_sasl_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.proxies = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.redis_db = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.redis_server = localhost:6379 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.retry_attempts = 2 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.retry_delay = 0.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.socket_keepalive_count = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.socket_keepalive_idle = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.socket_keepalive_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.socket_timeout = 1.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.tls_allowed_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.tls_cafile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.tls_certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.tls_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.tls_keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cache.username = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] coordination.backend_url = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.asyncio_connection = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.asyncio_slave_connection = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.backend = sqlalchemy {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.connection = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.connection_debug = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.connection_parameters = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.connection_recycle_time = 3600 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.connection_trace = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.db_inc_retry_interval = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.db_max_retries = 20 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.db_max_retry_interval = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.db_retry_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.max_overflow = 50 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.max_pool_size = 5 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.max_retries = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.mysql_wsrep_sync_wait = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.pool_timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.retry_interval = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.slave_connection = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.sqlite_synchronous = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.synchronous_reader = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] database.use_db_reconnect = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_tracing.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.connection_string = messaging:// {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.es_doc_type = notification {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.es_scroll_size = 10000 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.es_scroll_time = 2m {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.filter_error_trace = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.hmac_keys = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.sentinel_service_name = mymaster {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.socket_timeout = 0.1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.trace_requests = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler.trace_sqlalchemy = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler_jaeger.process_tags = {} {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler_jaeger.service_name_prefix = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] profiler_otlp.service_name_prefix = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_policy.enforce_new_defaults = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_policy.policy_default_rule = default {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_policy.policy_file = policy.yaml {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] privsep_osbrick.group = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] privsep_osbrick.helper_command = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] privsep_osbrick.user = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cinder_sys_admin.group = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cinder_sys_admin.helper_command = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] cinder_sys_admin.user = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.auth_section = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.auth_type = password {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.cafile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.collect_timing = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.send_service_user_token = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.split_loggers = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.tls_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] service_user.tls_min_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.auth_section = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.auth_type = password {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.collect_timing = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.region_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.split_loggers = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.tls_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] glance.tls_min_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.backend_availability_zone = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.chap_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.chap_username = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.disk_geometry = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.driver_client_cert = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.driver_client_cert_key = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.driver_data_namespace = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.driver_use_ssl = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.extra_capabilities = {} {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.filter_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85889) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 17:00:54 devstack quobyte-client[85890]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.goodness_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack quobyte-client[85890]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 17:00:54 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.quobyte [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.quobyte [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.iscsi_target_flags = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.iscsi_write_cache = on {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.iser_helper = tgtadm {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.iser_ip_address = 192.168.122.75 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Running cmd (subprocess): mount.quobyte {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.iser_port = 3260 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nas_host = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nas_login = admin {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nas_mount_options = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nas_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nas_private_key = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nas_share_path = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.num_shell_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.quobyte_volume_url = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.replication_device = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.report_discard_supported = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.reserved_percentage = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.target_helper = tgtadm {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.target_ip_address = 192.168.122.75 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.target_port = 3260 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.target_protocol = iscsi {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.trace_flags = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.unique_fqdn_network = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.use_chap_auth = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.volume_backend_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.volume_clear = zero {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.volume_clear_ionice = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.volume_clear_size = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_reports.file_event_handler = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_reports.log_dir = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.backend_availability_zone = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.backend_host = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.chap_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.chap_username = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.chiscsi_conf = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.disk_geometry = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.driver_client_cert = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.driver_data_namespace = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.driver_use_ssl = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.extra_capabilities = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.filter_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.goodness_function = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.iser_helper = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.iser_ip_address = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.iser_port = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.iser_target_prefix = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nas_host = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nas_login = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nas_mount_options = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nas_password = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nas_private_key = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nas_share_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nas_ssh_port = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.num_shell_tries = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.nvmet_port_id = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.replication_device = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.report_discard_supported = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.reserved_percentage = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.scst_target_driver = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.storage_protocol = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.target_helper = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.target_ip_address = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.target_port = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.target_prefix = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.target_protocol = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.trace_flags = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.use_chap_auth = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.volume_clear = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.volume_clear_size = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] QuobyteHD.volumes_dir = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] CMD "mount.quobyte" returned: 1 in 0.108s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.ssl = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_notifications.driver = [] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:00:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:00:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_notifications.retry = -1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] key_manager.fixed_key = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.barbican_api_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.barbican_endpoint = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.barbican_endpoint_type = public {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.barbican_region_name = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.cafile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.collect_timing = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.number_of_retries = 60 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.retry_delay = 1 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.send_service_user_token = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.split_loggers = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.tls_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.tls_min_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.verify_ssl = True {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican.verify_ssl_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.auth_section = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.auth_type = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.cafile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.certfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.collect_timing = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.insecure = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.keyfile = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.split_loggers = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.timeout = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.tls_ciphers = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] barbican_service_user.tls_min_version = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.approle_role_id = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.approle_secret_id = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.auth_method = approle {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.auth_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.kv_mountpoint = secret {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.kv_path = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.kv_version = 2 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.namespace = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.root_token_id = **** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.ssl_ca_crt_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.timeout = 60.0 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.token_file = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.token_role = None {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.use_ssl = False {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 17:00:54 devstack cinder-volume[85611]: DEBUG oslo_service.backend._eventlet.service [None req-0eb1278f-8c9b-406c-8915-5284d4516b98 None None] ******************************************************************************** {{(pid=85611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 17:00:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:00:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:00:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:55 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.292s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:55 devstack cinder-volume[85889]: INFO cinder.volume.driver [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Driver hasn't implemented _init_vendor_properties() Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG cinder.volume.driver [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.800148010254, 'free_capacity_gb': 1775.800148010254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85889) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_db.sqlalchemy.engines [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85889) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writer thread running {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG cinder.db.api [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Building query based on filter {{(pid=85889) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85889) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:55 devstack cinder-volume[85889]: INFO cinder.keymgr.migration [None req-d5a15730-59a3-40ab-9bac-796bab1b722a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 17:00:55 devstack sudo[85904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:00:55 devstack sudo[85904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:55 devstack sudo[85904]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.472s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:00:55 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Driver initialization completed successfully. Sep 17 17:00:55 devstack cinder-volume[85889]: INFO cinder.manager [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Initiating service 3 cleanup Sep 17 17:00:55 devstack cinder-volume[85889]: INFO cinder.manager [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Service 3 cleanup completed. Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG cinder.service [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Creating RPC server for service cinder-volume {{(pid=85889) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG cinder.service [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85889) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 17:00:55 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:00:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:00:56 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:00:56 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:00:56 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Sep 17 17:00:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.258s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:00:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a01e2ec5-c269-49be-a62d-e6c25e45035b None None] Driver post RPC initialization completed successfully. Sep 17 17:01:04 devstack cinder-volume[85611]: DEBUG dbcounter [-] [85611] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85611) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:01:05 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:01:06 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=3 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:01:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:01:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 6 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:01:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:02:10 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:02:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Flow 'volume_create_manager' (b29aae46-3e57-4cc3-87f1-c3be351c4cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:02:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862caceb-16b8-4299-ba78-f1af229749c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862caceb-16b8-4299-ba78-f1af229749c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1424331550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53dc7a0-a0d1-4185-8150-ba747a9b8ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff68ac15abd42aea2637894f7e20c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:02:10Z,use_quota=True,user_id='12e1c50ed9474ec5a5d1ebdb4bcd46b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b9f392-d9a7-4efa-96bb-6a4cf42c397c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b9f392-d9a7-4efa-96bb-6a4cf42c397c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d085af-3eaf-4078-8ef7-106437399912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d085af-3eaf-4078-8ef7-106437399912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c53dc7a0-a0d1-4185-8150-ba747a9b8ce9', 'volume_name': 'volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4510168-9ca4-42bf-82f3-04b9370a7b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4510168-9ca4-42bf-82f3-04b9370a7b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6157418-4be8-4186-86c3-54fad92ddfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:11 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Volume c53dc7a0-a0d1-4185-8150-ba747a9b8ce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9', 'volume_size': 1} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1424331550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53dc7a0-a0d1-4185-8150-ba747a9b8ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff68ac15abd42aea2637894f7e20c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:02:10Z,use_quota=True,user_id='12e1c50ed9474ec5a5d1ebdb4bcd46b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Creating volume c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:02:11 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:02:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:11 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 1073741824 Sep 17 17:02:11 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:13 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 1073741824" returned: 0 in 1.966s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:13 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 Sep 17 17:02:13 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:14 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9" returned: 0 in 0.833s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] <== create_volume: return (2997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:02:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6157418-4be8-4186-86c3-54fad92ddfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d391b0e2-76b6-43a2-b3f2-a771b7b3a9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:14 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Volume volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 (c53dc7a0-a0d1-4185-8150-ba747a9b8ce9): created successfully Sep 17 17:02:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d391b0e2-76b6-43a2-b3f2-a771b7b3a9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Flow 'volume_create_manager' (b29aae46-3e57-4cc3-87f1-c3be351c4cb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:02:14 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ebce3519-a9e6-4426-af87-65fdef3bd9ad tempest-DeleteServersTestJSON-901368581 None] Created volume successfully. Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Flow 'volume_create_manager' (b4f54f9a-af50-40d2-84dd-0df97062a120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6077470f-6722-48ff-8784-46a2d65872ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6077470f-6722-48ff-8784-46a2d65872ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-197852126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b365e41-394f-41f7-9b98-1439a0347ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda351f000f8449fa9194f5b697aaa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:02:18Z,use_quota=True,user_id='4b9391962f9f468391088bc273f63fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01fc9bb-b4df-48d4-bc8e-7b66f38d317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01fc9bb-b4df-48d4-bc8e-7b66f38d317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fca3772-0343-48b8-9d9a-f0fab1bfd698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fca3772-0343-48b8-9d9a-f0fab1bfd698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b365e41-394f-41f7-9b98-1439a0347ac4', 'volume_name': 'volume-1b365e41-394f-41f7-9b98-1439a0347ac4', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f7dc49-ab32-4a1d-aaca-61a51b6fdf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f7dc49-ab32-4a1d-aaca-61a51b6fdf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039669c8-b9a3-4591-ad97-79ed56d09715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:18 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Volume 1b365e41-394f-41f7-9b98-1439a0347ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b365e41-394f-41f7-9b98-1439a0347ac4', 'volume_size': 1} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-197852126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b365e41-394f-41f7-9b98-1439a0347ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda351f000f8449fa9194f5b697aaa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:02:18Z,use_quota=True,user_id='4b9391962f9f468391088bc273f63fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Creating volume 1b365e41-394f-41f7-9b98-1439a0347ac4 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:02:18 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:02:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:18 devstack sudo[87080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4 1073741824 Sep 17 17:02:18 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:19 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4 1073741824" returned: 0 in 0.831s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:19 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4 Sep 17 17:02:19 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:20 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4" returned: 0 in 0.547s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:02:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039669c8-b9a3-4591-ad97-79ed56d09715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b365e41-394f-41f7-9b98-1439a0347ac4', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400454bb-dbff-4727-a675-a2c9e2984153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:20 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Volume volume-1b365e41-394f-41f7-9b98-1439a0347ac4 (1b365e41-394f-41f7-9b98-1439a0347ac4): created successfully Sep 17 17:02:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400454bb-dbff-4727-a675-a2c9e2984153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Flow 'volume_create_manager' (b4f54f9a-af50-40d2-84dd-0df97062a120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:02:20 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7bc50993-a9df-44c0-bd07-5a7a6697285d tempest-VolumesAdminNegativeTest-890644441 None] Created volume successfully. Sep 17 17:02:21 devstack cinder-volume[85889]: WARNING py.warnings [req-e74bdd6c-3bb9-46fb-8ca0-6c585848d8c0 req-007ac4e6-a6de-4475-9f11-b4ce26f6c77f tempest-DeleteServersTestJSON-901368581 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 17 17:02:21 devstack cinder-volume[85889]: .first() Sep 17 17:02:21 devstack cinder-volume[85889]: Sep 17 17:02:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-e74bdd6c-3bb9-46fb-8ca0-6c585848d8c0 req-007ac4e6-a6de-4475-9f11-b4ce26f6c77f tempest-DeleteServersTestJSON-901368581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-e74bdd6c-3bb9-46fb-8ca0-6c585848d8c0 req-007ac4e6-a6de-4475-9f11-b4ce26f6c77f tempest-DeleteServersTestJSON-901368581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-e74bdd6c-3bb9-46fb-8ca0-6c585848d8c0 req-007ac4e6-a6de-4475-9f11-b4ce26f6c77f tempest-DeleteServersTestJSON-901368581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-e74bdd6c-3bb9-46fb-8ca0-6c585848d8c0 req-007ac4e6-a6de-4475-9f11-b4ce26f6c77f tempest-DeleteServersTestJSON-901368581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e0b4404-6e59-436d-8297-f5b0bdfc7e1d', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:02:21 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-e74bdd6c-3bb9-46fb-8ca0-6c585848d8c0 req-007ac4e6-a6de-4475-9f11-b4ce26f6c77f tempest-DeleteServersTestJSON-901368581 None] attachment_update completed successfully. Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Acquiring lock "cinder-1b365e41-394f-41f7-9b98-1439a0347ac4-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Lock "cinder-1b365e41-394f-41f7-9b98-1439a0347ac4-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:02:22 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:02:22 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Acquiring lock "cinder-quobyte-1b365e41-394f-41f7-9b98-1439a0347ac4" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:02:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Lock "cinder-quobyte-1b365e41-394f-41f7-9b98-1439a0347ac4" acquired by "delete_volume" :: waited 0.081s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:02:22 devstack cinder-volume[85889]: INFO oslo.privsep.daemon [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1xlast8g/privsep.sock'] Sep 17 17:02:22 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1xlast8g/privsep.sock Sep 17 17:02:22 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:23 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 1.063s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:23 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:02:23 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:02:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 7 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:02:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:02:24 devstack cinder-volume[85889]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 17 17:02:24 devstack cinder-volume[85889]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 17:02:24 devstack cinder-volume[85889]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 17 17:02:24 devstack cinder-volume[85889]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 17:02:24 devstack cinder-volume[85889]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 17 17:02:24 devstack cinder-volume[85889]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 17 17:02:24 devstack cinder-volume[85889]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 17:02:24 devstack cinder-volume[85889]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 17:02:24 devstack cinder-volume[85889]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 17 17:02:24 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:24 devstack cinder-volume[85889]: INFO oslo.privsep.daemon [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Spawned new privsep daemon via rootwrap Sep 17 17:02:24 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Accepted privsep connection to /tmp/tmp1xlast8g/privsep.sock {{(pid=85889) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 17 17:02:24 devstack cinder-volume[85889]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 17 17:02:24 devstack cinder-volume[85889]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 17 17:02:24 devstack cinder-volume[85889]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 17 17:02:24 devstack cinder-volume[85889]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87523 Sep 17 17:02:24 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f919b1ff-4fb0-457b-aa2b-ba81df986127]: (2,) {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:02:25 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bc9a77-6fb3-4e58-be62-77b3a171ce84]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:02:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:25 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4 Sep 17 17:02:25 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:25 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4" returned: 0 in 0.890s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:25 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4 Sep 17 17:02:25 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:26 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1b365e41-394f-41f7-9b98-1439a0347ac4" returned: 0 in 0.787s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Lock "cinder-quobyte-1b365e41-394f-41f7-9b98-1439a0347ac4" released by "delete_volume" :: held 4.090s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:02:26 devstack cinder-volume[85889]: WARNING cinder.quota [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:02:26 devstack cinder-volume[85889]: WARNING cinder.quota [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:02:26 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Created reservations ['7506026d-f85c-4902-8da1-be8cfd922d5b', '1e5f9170-104f-4e45-8320-7a630c1035aa', '232f3cad-1a70-40a6-9701-721467a15396', 'be27888b-c2c1-4378-a074-ec7ca3c4a0bc'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:02:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:02:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:02:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:27 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:02:27 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:27 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.408s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:27 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:02:27 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Deleted volume successfully. Sep 17 17:02:27 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd56be7e-3351-4191-8e4a-d96bb35db964 tempest-VolumesAdminNegativeTest-890644441 None] Lock "cinder-1b365e41-394f-41f7-9b98-1439a0347ac4-delete_volume" released by "delete_volume" :: held 5.217s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:02:28 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-e5fe31ae-6e4e-47e2-b7d2-87a780adcf54 req-f4fa7526-d48a-4c7e-86e7-bf9a09d5a7be tempest-DeleteServersTestJSON-901368581 None] Terminate volume connection completed successfully. Sep 17 17:02:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-e5fe31ae-6e4e-47e2-b7d2-87a780adcf54 req-f4fa7526-d48a-4c7e-86e7-bf9a09d5a7be tempest-DeleteServersTestJSON-901368581 None] Deleting attachment 2e0b4404-6e59-436d-8297-f5b0bdfc7e1d. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:02:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Acquiring lock "cinder-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:02:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Lock "cinder-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:02:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Acquiring lock "cinder-quobyte-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:02:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Lock "cinder-quobyte-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9" acquired by "delete_volume" :: waited 0.044s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:02:30 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd0be9b-a51f-4cd5-a31b-4f2d44359062]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:02:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:30 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 Sep 17 17:02:30 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:30 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9" returned: 0 in 0.431s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:30 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9 Sep 17 17:02:30 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:31 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9" returned: 0 in 0.277s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Lock "cinder-quobyte-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9" released by "delete_volume" :: held 0.772s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Created reservations ['6499830c-70de-4486-aa69-8b14fa66f8ae', '34bf8009-fda0-4575-bd20-9c4dccc1ce53', 'f7f83b6a-88f2-4ed9-a310-2040c24ec950', '6ab084f7-c5b8-494f-897d-95f6a7e91916'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:31 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:02:31 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:31 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.327s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:02:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Deleted volume successfully. Sep 17 17:02:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-589a5530-4367-4a74-82b5-344070393cec tempest-DeleteServersTestJSON-901368581 None] Lock "cinder-c53dc7a0-a0d1-4185-8150-ba747a9b8ce9-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:02:41 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=22,cinder:SELECT=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:02:41 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=17,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=3 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Flow 'volume_create_manager' (d2e784f4-04e2-423c-83a2-4c547ca349b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a1ad8f-4d73-4d52-b72c-5991536e95f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a1ad8f-4d73-4d52-b72c-5991536e95f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-824932448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4adc120-0f97-4cca-a999-a4e87eadb69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f6299163534e75bff559f78d844ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:02:50Z,use_quota=True,user_id='891d351f793e452588282d38f9c1c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b078ea6b-b27b-42e8-b222-342af50c247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b078ea6b-b27b-42e8-b222-342af50c247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24016e4c-3cc3-4fe8-abd4-dc59d83a1014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24016e4c-3cc3-4fe8-abd4-dc59d83a1014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4adc120-0f97-4cca-a999-a4e87eadb69b', 'volume_name': 'volume-c4adc120-0f97-4cca-a999-a4e87eadb69b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7007bc-f2ab-4994-b0ef-93442800de48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7007bc-f2ab-4994-b0ef-93442800de48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d27e8c-00d0-4bdb-a2ca-4e6bee1d3bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:50 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Volume c4adc120-0f97-4cca-a999-a4e87eadb69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4adc120-0f97-4cca-a999-a4e87eadb69b', 'volume_size': 1} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-824932448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4adc120-0f97-4cca-a999-a4e87eadb69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f6299163534e75bff559f78d844ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:02:50Z,use_quota=True,user_id='891d351f793e452588282d38f9c1c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Creating volume c4adc120-0f97-4cca-a999-a4e87eadb69b {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:02:50 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:50 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b 1073741824 Sep 17 17:02:50 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:50 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b 1073741824" returned: 0 in 0.529s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:02:50 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b Sep 17 17:02:50 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:02:51 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Sep 17 17:02:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b" returned: 0 in 0.334s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:02:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:02:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d27e8c-00d0-4bdb-a2ca-4e6bee1d3bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4adc120-0f97-4cca-a999-a4e87eadb69b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17040b17-b9c8-4fb9-bb9b-73536f062cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:02:51 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Volume volume-c4adc120-0f97-4cca-a999-a4e87eadb69b (c4adc120-0f97-4cca-a999-a4e87eadb69b): created successfully Sep 17 17:02:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17040b17-b9c8-4fb9-bb9b-73536f062cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:02:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Flow 'volume_create_manager' (d2e784f4-04e2-423c-83a2-4c547ca349b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:02:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f1406a68-98b9-48a2-8f45-96d934cf6862 tempest-AttachVolumeNegativeTest-1298711111 None] Created volume successfully. Sep 17 17:02:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-f7ef318e-f3d7-442c-b6fc-bcfc23b12f0d req-80b6d4ed-f3de-4465-a909-fddccc8451d4 tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:02:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-f7ef318e-f3d7-442c-b6fc-bcfc23b12f0d req-80b6d4ed-f3de-4465-a909-fddccc8451d4 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:02:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-f7ef318e-f3d7-442c-b6fc-bcfc23b12f0d req-80b6d4ed-f3de-4465-a909-fddccc8451d4 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:02:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f7ef318e-f3d7-442c-b6fc-bcfc23b12f0d req-80b6d4ed-f3de-4465-a909-fddccc8451d4 tempest-AttachVolumeNegativeTest-1298711111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-c4adc120-0f97-4cca-a999-a4e87eadb69b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e185ca6-7a07-4a10-94b6-5a957374f6a3', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:02:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-f7ef318e-f3d7-442c-b6fc-bcfc23b12f0d req-80b6d4ed-f3de-4465-a909-fddccc8451d4 tempest-AttachVolumeNegativeTest-1298711111 None] attachment_update completed successfully. Sep 17 17:03:04 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=7,cinder:SELECT=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Flow 'volume_create_manager' (a74a11ee-b129-46cb-a6ea-cb2d0701f9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42b3d2f-a1fb-4f2e-8daf-6b6939089e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42b3d2f-a1fb-4f2e-8daf-6b6939089e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-425330221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fef2e0d994f4a7ead301ccb7642c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:03:06Z,use_quota=True,user_id='7b34c862d76944f5be8ccc730f5619f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3dd56e-8d63-424d-8d81-a24321e79f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3dd56e-8d63-424d-8d81-a24321e79f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d575513f-1e5f-4815-8b9c-d7240fc7c0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d575513f-1e5f-4815-8b9c-d7240fc7c0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70', 'volume_name': 'volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac6472b-cb82-4bd9-b3a4-ba74abd1cdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac6472b-cb82-4bd9-b3a4-ba74abd1cdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13811857-0091-45c5-b84b-1d267ac99700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:06 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Volume 8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70', 'volume_size': 1} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-425330221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fef2e0d994f4a7ead301ccb7642c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:03:06Z,use_quota=True,user_id='7b34c862d76944f5be8ccc730f5619f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Creating volume 8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:03:06 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:03:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:06 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 1073741824 Sep 17 17:03:06 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:07 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 1073741824" returned: 0 in 0.543s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:07 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 Sep 17 17:03:07 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:07 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70" returned: 0 in 0.294s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:03:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:07 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13811857-0091-45c5-b84b-1d267ac99700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:07 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8822a89-4330-4931-a18d-d29c9bb58c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:07 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Volume volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 (8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70): created successfully Sep 17 17:03:07 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8822a89-4330-4931-a18d-d29c9bb58c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:07 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Flow 'volume_create_manager' (a74a11ee-b129-46cb-a6ea-cb2d0701f9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:03:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-8d000ddf-438c-4411-86a0-5d89f06bba67 tempest-VolumesTestJSON-102391815 None] Created volume successfully. Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Flow 'volume_create_manager' (ee5322d8-a3b9-4f5e-af6e-0ad0b7db958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c28ebd-fe5d-4044-aee6-c7928137bf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c28ebd-fe5d-4044-aee6-c7928137bf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-43875926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e506c77a-63ff-4175-a368-a678019b2e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cb087f99d54a70a1931e8148df3fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:03:09Z,use_quota=True,user_id='dfa55980e2f8477f873c586eaf92e151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396ecda5-fb4c-4b24-a8e2-01d4fc8b5de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396ecda5-fb4c-4b24-a8e2-01d4fc8b5de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91db2a0-151b-4139-a02a-af40089605b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91db2a0-151b-4139-a02a-af40089605b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e506c77a-63ff-4175-a368-a678019b2e8d', 'volume_name': 'volume-e506c77a-63ff-4175-a368-a678019b2e8d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea23f915-a061-4113-8d73-97c5be1583b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea23f915-a061-4113-8d73-97c5be1583b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9cfa19-5614-4fb9-bbb0-6eca9e83cafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:09 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Volume e506c77a-63ff-4175-a368-a678019b2e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e506c77a-63ff-4175-a368-a678019b2e8d', 'volume_size': 1} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-43875926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e506c77a-63ff-4175-a368-a678019b2e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cb087f99d54a70a1931e8148df3fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:03:09Z,use_quota=True,user_id='dfa55980e2f8477f873c586eaf92e151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Creating volume e506c77a-63ff-4175-a368-a678019b2e8d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:03:09 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:09 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d 1073741824 Sep 17 17:03:09 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Flow 'volume_create_manager' (d1d1b097-838c-4c9c-9e45-b7fabf379131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f128eb-1803-4a47-ba3e-649e094029fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f128eb-1803-4a47-ba3e-649e094029fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1105092532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2340e879-ff1d-49a2-9aaa-8543f5300926,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fef2e0d994f4a7ead301ccb7642c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:03:09Z,use_quota=True,user_id='7b34c862d76944f5be8ccc730f5619f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffdb388-97b8-4852-8804-e9f3c3624898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffdb388-97b8-4852-8804-e9f3c3624898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec01015-9122-4e4c-9c57-1feb173079b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec01015-9122-4e4c-9c57-1feb173079b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2340e879-ff1d-49a2-9aaa-8543f5300926', 'volume_name': 'volume-2340e879-ff1d-49a2-9aaa-8543f5300926', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87460c99-ebfb-45e2-a652-148a888d542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87460c99-ebfb-45e2-a652-148a888d542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab14cb7-52af-4c05-8a4f-1ad2ecf09e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:09 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Volume 2340e879-ff1d-49a2-9aaa-8543f5300926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2340e879-ff1d-49a2-9aaa-8543f5300926', 'volume_size': 1} Sep 17 17:03:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:10 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d 1073741824" returned: 0 in 0.690s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:10 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d Sep 17 17:03:10 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:10 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d" returned: 0 in 0.470s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.072s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1105092532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2340e879-ff1d-49a2-9aaa-8543f5300926,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fef2e0d994f4a7ead301ccb7642c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:03:09Z,use_quota=True,user_id='7b34c862d76944f5be8ccc730f5619f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Creating volume 2340e879-ff1d-49a2-9aaa-8543f5300926 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:03:10 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:10 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926 1073741824 Sep 17 17:03:10 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9cfa19-5614-4fb9-bbb0-6eca9e83cafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e506c77a-63ff-4175-a368-a678019b2e8d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92db68f-85b0-4e9b-b479-4ca651fbcb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:10 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Volume volume-e506c77a-63ff-4175-a368-a678019b2e8d (e506c77a-63ff-4175-a368-a678019b2e8d): created successfully Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92db68f-85b0-4e9b-b479-4ca651fbcb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Flow 'volume_create_manager' (ee5322d8-a3b9-4f5e-af6e-0ad0b7db958b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:03:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bf3bd9ce-8d72-425a-8c60-a070491821ba tempest-TaggedAttachmentsTest-825477512 None] Created volume successfully. Sep 17 17:03:11 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926 1073741824" returned: 0 in 0.859s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:11 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926 Sep 17 17:03:11 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:12 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926" returned: 0 in 0.401s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:03:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab14cb7-52af-4c05-8a4f-1ad2ecf09e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2340e879-ff1d-49a2-9aaa-8543f5300926', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc83b07-2886-4f78-81a9-1fab6171942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:12 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Volume volume-2340e879-ff1d-49a2-9aaa-8543f5300926 (2340e879-ff1d-49a2-9aaa-8543f5300926): created successfully Sep 17 17:03:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc83b07-2886-4f78-81a9-1fab6171942b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Flow 'volume_create_manager' (d1d1b097-838c-4c9c-9e45-b7fabf379131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:03:12 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-929a9da9-057c-43d7-b4be-1e5894fd12b0 tempest-VolumesTestJSON-102391815 None] Created volume successfully. Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Flow 'volume_create_manager' (15a7b06a-d890-4726-8c4c-a981ba14d923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7df7471-2b22-4d44-a0ed-202a68ed31e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7df7471-2b22-4d44-a0ed-202a68ed31e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1446511188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9de56c-8060-484c-913e-ebd474c4a624,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fef2e0d994f4a7ead301ccb7642c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:03:14Z,use_quota=True,user_id='7b34c862d76944f5be8ccc730f5619f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd83b32-2207-4979-88e0-66dbc5f0a6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd83b32-2207-4979-88e0-66dbc5f0a6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f390cb1-a7b2-41fe-b3e2-bb1127e9e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f390cb1-a7b2-41fe-b3e2-bb1127e9e022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c9de56c-8060-484c-913e-ebd474c4a624', 'volume_name': 'volume-1c9de56c-8060-484c-913e-ebd474c4a624', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bca903-e3bf-4b4a-88d0-fd9197163c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bca903-e3bf-4b4a-88d0-fd9197163c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123f8e0e-7093-49ea-b0da-8ebf30eb163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:14 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Volume 1c9de56c-8060-484c-913e-ebd474c4a624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c9de56c-8060-484c-913e-ebd474c4a624', 'volume_size': 1} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1446511188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c9de56c-8060-484c-913e-ebd474c4a624,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fef2e0d994f4a7ead301ccb7642c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:03:14Z,use_quota=True,user_id='7b34c862d76944f5be8ccc730f5619f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Creating volume 1c9de56c-8060-484c-913e-ebd474c4a624 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:03:14 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:03:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:14 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624 1073741824 Sep 17 17:03:14 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:15 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624 1073741824" returned: 0 in 0.685s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:15 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624 Sep 17 17:03:15 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:16 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624" returned: 0 in 0.589s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:03:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123f8e0e-7093-49ea-b0da-8ebf30eb163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c9de56c-8060-484c-913e-ebd474c4a624', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7858dc5-f936-45e8-a9bb-99ff70fdfd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:16 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Volume volume-1c9de56c-8060-484c-913e-ebd474c4a624 (1c9de56c-8060-484c-913e-ebd474c4a624): created successfully Sep 17 17:03:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7858dc5-f936-45e8-a9bb-99ff70fdfd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Flow 'volume_create_manager' (15a7b06a-d890-4726-8c4c-a981ba14d923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:03:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-128f75d6-9a43-4e3d-9e83-0423a2364a7f tempest-VolumesTestJSON-102391815 None] Created volume successfully. Sep 17 17:03:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Acquiring lock "cinder-1c9de56c-8060-484c-913e-ebd474c4a624-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:03:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Lock "cinder-1c9de56c-8060-484c-913e-ebd474c4a624-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:03:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Acquiring lock "cinder-quobyte-1c9de56c-8060-484c-913e-ebd474c4a624" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:03:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Lock "cinder-quobyte-1c9de56c-8060-484c-913e-ebd474c4a624" acquired by "delete_volume" :: waited 0.045s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:03:19 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ed3c2d-7701-4033-be1c-9537f2aff1e8]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:03:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:19 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624 Sep 17 17:03:19 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:20 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624" returned: 0 in 0.739s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:20 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624 Sep 17 17:03:20 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:21 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1c9de56c-8060-484c-913e-ebd474c4a624" returned: 0 in 0.597s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Lock "cinder-quobyte-1c9de56c-8060-484c-913e-ebd474c4a624" released by "delete_volume" :: held 1.460s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:03:21 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Created reservations ['da3e8e4d-4f77-4781-9297-86d7a4914cf9', '3f693f58-3498-4146-b721-0918ed471536', '5c90a409-8d11-4189-b23e-637f05f2ac29', 'c9caebfa-6d78-49c1-a128-b62649de2f2d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:03:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:03:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:03:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:21 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:03:21 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:22 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.707s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:03:22 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Deleted volume successfully. Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-213edfe7-52d6-45bf-b49c-ce9d5a1d7d0b tempest-VolumesTestJSON-102391815 None] Lock "cinder-1c9de56c-8060-484c-913e-ebd474c4a624-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Acquiring lock "cinder-2340e879-ff1d-49a2-9aaa-8543f5300926-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Lock "cinder-2340e879-ff1d-49a2-9aaa-8543f5300926-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Acquiring lock "cinder-quobyte-2340e879-ff1d-49a2-9aaa-8543f5300926" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Lock "cinder-quobyte-2340e879-ff1d-49a2-9aaa-8543f5300926" acquired by "delete_volume" :: waited 0.042s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:03:22 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:03:22 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb1010f-d3be-4dc8-ac52-950e54fa5fe5]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:03:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:22 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926 Sep 17 17:03:22 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:23 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.851s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:03:23 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926" returned: 0 in 0.792s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:23 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926 Sep 17 17:03:23 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:23 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2340e879-ff1d-49a2-9aaa-8543f5300926" returned: 0 in 0.442s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Lock "cinder-quobyte-2340e879-ff1d-49a2-9aaa-8543f5300926" released by "delete_volume" :: held 1.336s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Created reservations ['db5315cb-9b6a-46b4-bdf5-38477743a084', 'b51ee178-f6d0-494e-b738-74f38ce16a31', '5446c5da-196d-4ce8-918e-b8eb2d29ce5c', 'e0942e06-9d8d-4f9d-ae2f-5396226f16af'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:23 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:03:23 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:24 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.289s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:24 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:03:24 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Deleted volume successfully. Sep 17 17:03:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-db5bf81f-b0d2-446f-b686-e1bc500076ee tempest-VolumesTestJSON-102391815 None] Lock "cinder-2340e879-ff1d-49a2-9aaa-8543f5300926-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:03:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Acquiring lock "cinder-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:03:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Lock "cinder-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:03:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Acquiring lock "cinder-quobyte-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:03:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Lock "cinder-quobyte-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70" acquired by "delete_volume" :: waited 0.041s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:03:24 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[75acf3f2-a3a2-4c8c-8257-b3aa19c5be98]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:03:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:25 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 Sep 17 17:03:25 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:25 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70" returned: 0 in 0.556s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:25 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70 Sep 17 17:03:25 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70" returned: 0 in 0.408s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:25 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Lock "cinder-quobyte-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70" released by "delete_volume" :: held 1.099s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:03:26 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Created reservations ['46b15042-775b-443a-baad-1897b72dd52d', '96bb80b3-e30d-42db-a5c1-f9428cd5288c', '63f6d1ec-b7bf-4d64-9f39-ee79ad142c9f', '08d746d3-858e-4f60-8495-a32f3042bf79'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:03:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:03:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:03:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:26 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:03:26 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:27 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.814s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:27 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:03:27 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Deleted volume successfully. Sep 17 17:03:27 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3946ad16-2354-41ac-83a5-07b283c94a96 tempest-VolumesTestJSON-102391815 None] Lock "cinder-8d7c7bd0-3c35-409c-ace8-6fc9a4bdbb70-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:03:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f23e4f3-987b-44f4-8c3f-a2c77633be88 tempest-BackendsCapabilitiesAdminTestsJSON-1420133419 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.800148010254, 'free_capacity_gb': 1775.800148010254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85889) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 17:03:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b128cbb-c4ea-4b81-9d1f-11389b70a0b6 tempest-BackendsCapabilitiesAdminTestsJSON-1420133419 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.800148010254, 'free_capacity_gb': 1775.800148010254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85889) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 17:03:36 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=42,cinder:SELECT=15,cinder:DELETE=4,cinder:INSERT=7 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:03:37 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=31,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Flow 'volume_create_manager' (6c45d2c6-8f20-420d-b87d-9604ade17abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346b1fbc-e56b-454a-a5fd-794f462fad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346b1fbc-e56b-454a-a5fd-794f462fad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-942499410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f690e451-d908-4aa9-bd59-ffbc3d02e1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6b1a814b78448aaa44e0a375d1ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:03:40Z,use_quota=True,user_id='5fefccf1ad6046beb0a9a05ca0f35c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f1a5f0-1861-434e-b910-e5b29ae4c7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f1a5f0-1861-434e-b910-e5b29ae4c7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1db8835-6f13-4882-966f-1e8523dbfb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1db8835-6f13-4882-966f-1e8523dbfb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f690e451-d908-4aa9-bd59-ffbc3d02e1a7', 'volume_name': 'volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b41d74-d43a-46d2-b4af-67204c81352b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b41d74-d43a-46d2-b4af-67204c81352b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86b1d25-60f5-4114-a1ee-be36ce8e77f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:39 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Volume f690e451-d908-4aa9-bd59-ffbc3d02e1a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7', 'volume_size': 1} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-942499410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f690e451-d908-4aa9-bd59-ffbc3d02e1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6b1a814b78448aaa44e0a375d1ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:03:40Z,use_quota=True,user_id='5fefccf1ad6046beb0a9a05ca0f35c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Creating volume f690e451-d908-4aa9-bd59-ffbc3d02e1a7 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:03:39 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:03:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:39 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7 1073741824 Sep 17 17:03:39 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:40 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7 1073741824" returned: 0 in 0.581s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:03:40 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7 Sep 17 17:03:40 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:03:40 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Sep 17 17:03:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7" returned: 0 in 0.305s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:03:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:03:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:03:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86b1d25-60f5-4114-a1ee-be36ce8e77f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0aef24-9426-478c-b37e-fcff51f8c0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:03:40 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Volume volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7 (f690e451-d908-4aa9-bd59-ffbc3d02e1a7): created successfully Sep 17 17:03:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0aef24-9426-478c-b37e-fcff51f8c0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:03:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Flow 'volume_create_manager' (6c45d2c6-8f20-420d-b87d-9604ade17abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:03:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-75874287-92bf-44ed-a90f-deb9ee9728fa tempest-ServerActionsTestOtherA-1009400035 None] Created volume successfully. Sep 17 17:03:49 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-f715ea19-be9f-4b3c-92b7-eb88332d22ea req-453f9ef4-7e55-4953-9051-4ce4aa3aa759 tempest-AttachVolumeNegativeTest-1298711111 None] Terminate volume connection completed successfully. Sep 17 17:03:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f715ea19-be9f-4b3c-92b7-eb88332d22ea req-453f9ef4-7e55-4953-9051-4ce4aa3aa759 tempest-AttachVolumeNegativeTest-1298711111 None] Deleting attachment 0e185ca6-7a07-4a10-94b6-5a957374f6a3. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:03:59 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:03:59 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3,cinder:DELETE=1 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:04:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-8816cac5-16ee-41aa-b1b5-8814d418eaa7 req-dba69afb-e1a5-46df-9211-a38aa74d4495 tempest-TaggedAttachmentsTest-825477512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-8816cac5-16ee-41aa-b1b5-8814d418eaa7 req-dba69afb-e1a5-46df-9211-a38aa74d4495 tempest-TaggedAttachmentsTest-825477512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-8816cac5-16ee-41aa-b1b5-8814d418eaa7 req-dba69afb-e1a5-46df-9211-a38aa74d4495 tempest-TaggedAttachmentsTest-825477512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-8816cac5-16ee-41aa-b1b5-8814d418eaa7 req-dba69afb-e1a5-46df-9211-a38aa74d4495 tempest-TaggedAttachmentsTest-825477512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-e506c77a-63ff-4175-a368-a678019b2e8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72dd1b77-989d-4625-8186-cb82db737f02', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:04:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-8816cac5-16ee-41aa-b1b5-8814d418eaa7 req-dba69afb-e1a5-46df-9211-a38aa74d4495 tempest-TaggedAttachmentsTest-825477512 None] attachment_update completed successfully. Sep 17 17:04:05 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-a71935b8-fe14-42f0-a4c6-52b7b5920170 req-008d915c-1813-48cb-b674-397b1b7abad5 tempest-TaggedAttachmentsTest-825477512 None] Terminate volume connection completed successfully. Sep 17 17:04:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-a71935b8-fe14-42f0-a4c6-52b7b5920170 req-008d915c-1813-48cb-b674-397b1b7abad5 tempest-TaggedAttachmentsTest-825477512 None] Deleting attachment 72dd1b77-989d-4625-8186-cb82db737f02. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Flow 'volume_create_manager' (4d49e284-85f3-4a8b-bf1f-d47ba7848be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff21830-afb3-4a5d-a1d4-58b66886760d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff21830-afb3-4a5d-a1d4-58b66886760d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-843188352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1e3a9e-78f3-4b04-8335-aae606fdb166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1023ec1a0049cea698bb193e38716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:04:06Z,use_quota=True,user_id='f67b075dc0c34613a3fca88713d8408b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241ee2ca-a488-4546-9e50-72092ef429ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241ee2ca-a488-4546-9e50-72092ef429ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0c4f2c-aa5c-48c1-8baf-56d9eec06816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0c4f2c-aa5c-48c1-8baf-56d9eec06816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1e3a9e-78f3-4b04-8335-aae606fdb166', 'volume_name': 'volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466ab070-f38d-4f24-980a-e3598142a781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466ab070-f38d-4f24-980a-e3598142a781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0cbc5e8-2c44-4816-ab84-354e2d4e973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:06 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Volume 7c1e3a9e-78f3-4b04-8335-aae606fdb166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166', 'volume_size': 1} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-843188352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1e3a9e-78f3-4b04-8335-aae606fdb166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1023ec1a0049cea698bb193e38716d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:04:06Z,use_quota=True,user_id='f67b075dc0c34613a3fca88713d8408b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Creating volume 7c1e3a9e-78f3-4b04-8335-aae606fdb166 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:04:06 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:04:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:06 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 1073741824 Sep 17 17:04:06 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:07 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 1073741824" returned: 0 in 0.657s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:07 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 Sep 17 17:04:07 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:07 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166" returned: 0 in 0.326s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:04:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:07 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0cbc5e8-2c44-4816-ab84-354e2d4e973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:07 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb440bf-7c89-4058-932a-d73515255cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:07 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Volume volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 (7c1e3a9e-78f3-4b04-8335-aae606fdb166): created successfully Sep 17 17:04:07 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb440bf-7c89-4058-932a-d73515255cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:07 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Flow 'volume_create_manager' (4d49e284-85f3-4a8b-bf1f-d47ba7848be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:04:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3c982e92-2a09-4b47-ba78-3ce8fd87233d tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Created volume successfully. Sep 17 17:04:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Creating offline snapshot c7cc4335-a703-40bc-992f-0ab2ba1cb60a of volume 7c1e3a9e-78f3-4b04-8335-aae606fdb166 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:04:09 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[737dfae6-b38d-4189-86b5-d4773a8540f2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:04:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:09 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 Sep 17 17:04:09 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:09 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166" returned: 0 in 0.473s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:09 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a 1G Sep 17 17:04:09 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:10 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a 1G" returned: 0 in 0.644s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:10 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a Sep 17 17:04:10 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:10 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a" returned: 0 in 0.335s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:10 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a is being set with open permissions: ugo+rw Sep 17 17:04:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:10 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a Sep 17 17:04:10 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:10 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a" returned: 0 in 0.313s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:10 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.info Sep 17 17:04:10 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:11 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.info" returned: 0 in 0.401s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:11 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.info is being set with open permissions: ugo+rw Sep 17 17:04:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:11 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.info Sep 17 17:04:11 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:11 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.info" returned: 0 in 0.619s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.045s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:12 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-741694ec-2be3-45f1-ba89-e3338355a921 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Create snapshot completed successfully Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Acquiring lock "cinder-c7cc4335-a703-40bc-992f-0ab2ba1cb60a-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "cinder-c7cc4335-a703-40bc-992f-0ab2ba1cb60a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Acquiring lock "cinder-quobyte-7c1e3a9e-78f3-4b04-8335-aae606fdb166" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "cinder-quobyte-7c1e3a9e-78f3-4b04-8335-aae606fdb166" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Acquiring lock "cinder-quobyte-c7cc4335-a703-40bc-992f-0ab2ba1cb60a" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "cinder-quobyte-c7cc4335-a703-40bc-992f-0ab2ba1cb60a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Deleting offline snapshot c7cc4335-a703-40bc-992f-0ab2ba1cb60a of volume 7c1e3a9e-78f3-4b04-8335-aae606fdb166 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] snapshot_file for this snap is: volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[08975439-ad78-4926-bbaa-1a5bdfc8ebdb]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:14 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a Sep 17 17:04:14 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:14 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a" returned: 0 in 0.476s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a8c95a-3720-4303-b075-430cbd70db9b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:04:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:14 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 Sep 17 17:04:14 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:15 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166" returned: 0 in 0.579s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:15 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a Sep 17 17:04:15 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:15 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a" returned: 0 in 0.511s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:15 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a Sep 17 17:04:15 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:16 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166.c7cc4335-a703-40bc-992f-0ab2ba1cb60a" returned: 0 in 0.331s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "cinder-quobyte-c7cc4335-a703-40bc-992f-0ab2ba1cb60a" released by "_delete_snapshot" :: held 2.078s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:04:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "cinder-quobyte-7c1e3a9e-78f3-4b04-8335-aae606fdb166" released by "delete_snapshot" :: held 2.106s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:04:16 devstack cinder-volume[85889]: WARNING cinder.quota [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:04:16 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Created reservations ['0fb69518-bfea-4e05-92a8-b8e5a53d346f', 'beeb9e3d-6463-4bca-940e-a6b2627a8efe', '60b6b2f1-ca25-4157-bb22-460fb8e49d9a', '660ce455-0ae5-41b8-b8db-86ecfda0a778'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:04:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Delete snapshot completed successfully. Sep 17 17:04:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e4f15a6b-ade2-4c49-8187-f5c25cf6dca6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "cinder-c7cc4335-a703-40bc-992f-0ab2ba1cb60a-delete_snapshot" released by "delete_snapshot" :: held 2.348s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:04:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-db37c002-8e68-4d77-87dd-359139417888 req-a7b660b9-0b56-4a43-9630-417f1be927bd tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-db37c002-8e68-4d77-87dd-359139417888 req-a7b660b9-0b56-4a43-9630-417f1be927bd tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-db37c002-8e68-4d77-87dd-359139417888 req-a7b660b9-0b56-4a43-9630-417f1be927bd tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-db37c002-8e68-4d77-87dd-359139417888 req-a7b660b9-0b56-4a43-9630-417f1be927bd tempest-ServerActionsTestOtherA-1009400035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e247b11-2b53-4d57-8654-8b2e1d139bea', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:04:17 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-db37c002-8e68-4d77-87dd-359139417888 req-a7b660b9-0b56-4a43-9630-417f1be927bd tempest-ServerActionsTestOtherA-1009400035 None] attachment_update completed successfully. Sep 17 17:04:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Acquiring lock "cinder-7c1e3a9e-78f3-4b04-8335-aae606fdb166-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:04:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "cinder-7c1e3a9e-78f3-4b04-8335-aae606fdb166-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:04:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Acquiring lock "cinder-quobyte-7c1e3a9e-78f3-4b04-8335-aae606fdb166" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:04:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "cinder-quobyte-7c1e3a9e-78f3-4b04-8335-aae606fdb166" acquired by "delete_volume" :: waited 0.043s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:04:17 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41a011b-7c3b-4132-8397-7c87ae68dd52]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:04:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:17 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 Sep 17 17:04:17 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:18 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166" returned: 0 in 0.546s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:18 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166 Sep 17 17:04:18 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Acquiring lock "cinder-e506c77a-63ff-4175-a368-a678019b2e8d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Lock "cinder-e506c77a-63ff-4175-a368-a678019b2e8d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Acquiring lock "cinder-quobyte-e506c77a-63ff-4175-a368-a678019b2e8d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:04:18 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7c1e3a9e-78f3-4b04-8335-aae606fdb166" returned: 0 in 0.321s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Lock "cinder-quobyte-e506c77a-63ff-4175-a368-a678019b2e8d" acquired by "delete_volume" :: waited 0.036s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "cinder-quobyte-7c1e3a9e-78f3-4b04-8335-aae606fdb166" released by "delete_volume" :: held 0.998s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[895e7b59-2b7f-4a30-832c-66faefe44484]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Created reservations ['f3a25456-39fd-4b61-ab4c-493f24921142', 'fa047889-4e53-4550-9143-70ed190407ff', '976388dc-ab36-42ba-976b-8d88558e76fc', '1f4b0fb0-c577-46ca-aeb5-79d20938ea56'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:18 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:04:18 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:18 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d Sep 17 17:04:18 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:19 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.309s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:04:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Deleted volume successfully. Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f67d82d3-b963-45f1-b20a-ac0b16af09e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1021007951 None] Lock "cinder-7c1e3a9e-78f3-4b04-8335-aae606fdb166-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:04:19 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d" returned: 0 in 0.535s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:19 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d Sep 17 17:04:19 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:19 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e506c77a-63ff-4175-a368-a678019b2e8d" returned: 0 in 0.264s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Lock "cinder-quobyte-e506c77a-63ff-4175-a368-a678019b2e8d" released by "delete_volume" :: held 0.870s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Created reservations ['4893e76c-4db5-439e-bd8e-f7826addd073', '9e7eda07-e583-4176-891f-ba969f818332', '41243204-2c31-40e1-a425-96665cbea60d', '6cc2d21c-bbc6-400d-b99d-71660a7ef04e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:19 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:04:19 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:20 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.304s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:20 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:04:20 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Deleted volume successfully. Sep 17 17:04:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6ee7851b-4bd2-4fe5-bae4-450997826433 tempest-TaggedAttachmentsTest-825477512 None] Lock "cinder-e506c77a-63ff-4175-a368-a678019b2e8d-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:04:21 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-a59a4620-bdd4-4e29-a99c-b24ea3dc911d req-e3ae301e-9c8b-46bd-ba7d-74ad54fee0bd tempest-ServerActionsTestOtherA-1009400035 None] Terminate volume connection completed successfully. Sep 17 17:04:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-a59a4620-bdd4-4e29-a99c-b24ea3dc911d req-e3ae301e-9c8b-46bd-ba7d-74ad54fee0bd tempest-ServerActionsTestOtherA-1009400035 None] Deleting attachment 2e247b11-2b53-4d57-8654-8b2e1d139bea. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:22 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:04:22 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-a59a4620-bdd4-4e29-a99c-b24ea3dc911d req-2827eb57-5cb9-4355-81d5-60ae90226a1e tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-a59a4620-bdd4-4e29-a99c-b24ea3dc911d req-2827eb57-5cb9-4355-81d5-60ae90226a1e tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-a59a4620-bdd4-4e29-a99c-b24ea3dc911d req-2827eb57-5cb9-4355-81d5-60ae90226a1e tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-a59a4620-bdd4-4e29-a99c-b24ea3dc911d req-2827eb57-5cb9-4355-81d5-60ae90226a1e tempest-ServerActionsTestOtherA-1009400035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ce52890-94a5-4bdc-b24d-590d5f705e46', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:04:22 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.667s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:04:23 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:04:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 8 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:04:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:04:23 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-a59a4620-bdd4-4e29-a99c-b24ea3dc911d req-2827eb57-5cb9-4355-81d5-60ae90226a1e tempest-ServerActionsTestOtherA-1009400035 None] attachment_update completed successfully. Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=43,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=5 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=42,cinder:UPDATE=29,cinder:INSERT=9,cinder:DELETE=2 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Flow 'volume_create_manager' (df0f6629-3c54-41a9-b5c3-d0b536dac772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a085ba-c1a2-4cbc-86ce-02abc0a3935a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a085ba-c1a2-4cbc-86ce-02abc0a3935a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-757208253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d383f769-167b-49c0-9a5d-0a1a15f7f45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f6299163534e75bff559f78d844ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:04:33Z,use_quota=True,user_id='891d351f793e452588282d38f9c1c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca419830-bc28-4bbf-9678-a5743923c190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca419830-bc28-4bbf-9678-a5743923c190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487ce936-0952-429b-b82f-fdaea9751de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487ce936-0952-429b-b82f-fdaea9751de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd383f769-167b-49c0-9a5d-0a1a15f7f45f', 'volume_name': 'volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4fcba9-5110-4c73-ba11-b498bdfe7947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4fcba9-5110-4c73-ba11-b498bdfe7947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7df8ad0-ef90-46ed-aac9-d312cd8ba279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:33 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Volume d383f769-167b-49c0-9a5d-0a1a15f7f45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f', 'volume_size': 1} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-757208253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d383f769-167b-49c0-9a5d-0a1a15f7f45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f6299163534e75bff559f78d844ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:04:33Z,use_quota=True,user_id='891d351f793e452588282d38f9c1c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Creating volume d383f769-167b-49c0-9a5d-0a1a15f7f45f {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:04:33 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:04:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:33 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f 1073741824 Sep 17 17:04:33 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:34 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f 1073741824" returned: 0 in 0.886s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:34 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f Sep 17 17:04:34 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:34 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f" returned: 0 in 0.406s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:04:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7df8ad0-ef90-46ed-aac9-d312cd8ba279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481a8733-f812-455f-bfd2-0c68e33e4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:34 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Volume volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f (d383f769-167b-49c0-9a5d-0a1a15f7f45f): created successfully Sep 17 17:04:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481a8733-f812-455f-bfd2-0c68e33e4537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Flow 'volume_create_manager' (df0f6629-3c54-41a9-b5c3-d0b536dac772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:04:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3102290c-ad51-43e1-bfe7-f6ed7aab3f6a tempest-AttachVolumeNegativeTest-1298711111 None] Created volume successfully. Sep 17 17:04:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-ae875b67-7d4f-46d0-8d18-76b8fbf45fc9 req-d83407d6-9fe0-40bc-af45-1b0f61868fcf tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-ae875b67-7d4f-46d0-8d18-76b8fbf45fc9 req-d83407d6-9fe0-40bc-af45-1b0f61868fcf tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-ae875b67-7d4f-46d0-8d18-76b8fbf45fc9 req-d83407d6-9fe0-40bc-af45-1b0f61868fcf tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-ae875b67-7d4f-46d0-8d18-76b8fbf45fc9 req-d83407d6-9fe0-40bc-af45-1b0f61868fcf tempest-AttachVolumeNegativeTest-1298711111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcf73036-00a2-4400-9e98-bbee1e685e40', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:04:36 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-ae875b67-7d4f-46d0-8d18-76b8fbf45fc9 req-d83407d6-9fe0-40bc-af45-1b0f61868fcf tempest-AttachVolumeNegativeTest-1298711111 None] attachment_update completed successfully. Sep 17 17:04:39 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:04:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Flow 'volume_create_manager' (16014d7f-d61b-4cd3-9f0d-a1a558add6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:04:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3dcf1b3-5fda-4cbb-afcf-f99729219ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3dcf1b3-5fda-4cbb-afcf-f99729219ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1514426510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08122a98-a16a-41a4-8874-9eb1fac972af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5137a394ead4194bdb5d97e641b8ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:04:39Z,use_quota=True,user_id='c04c3957a5804a1dac3b141cae89109a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba38ef6c-1e4c-4aa6-991a-deeeb98c5f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba38ef6c-1e4c-4aa6-991a-deeeb98c5f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1ca7f7-01a7-4eda-a4d2-0ea782a9d86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:39 devstack cinder-volume[85889]: DEBUG cinder.image.glance [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Creating Keystone auth plugin from conf {{(pid=85889) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 17:04:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-9f8955f0-a226-484b-ac97-ffd62a6485e0 req-81a81824-be8e-480d-984d-a60f58a60a53 tempest-AttachVolumeNegativeTest-1298711111 None] Terminate volume connection completed successfully. Sep 17 17:04:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-9f8955f0-a226-484b-ac97-ffd62a6485e0 req-81a81824-be8e-480d-984d-a60f58a60a53 tempest-AttachVolumeNegativeTest-1298711111 None] Deleting attachment bcf73036-00a2-4400-9e98-bbee1e685e40. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:04:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1ca7f7-01a7-4eda-a4d2-0ea782a9d86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08122a98-a16a-41a4-8874-9eb1fac972af', 'volume_name': 'volume-08122a98-a16a-41a4-8874-9eb1fac972af', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b73b31e-3681-4344-a469-6fc1ca2b47d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b73b31e-3681-4344-a469-6fc1ca2b47d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180c8bae-22e5-40dd-82d6-b22181ff79cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:40 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Volume 08122a98-a16a-41a4-8874-9eb1fac972af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08122a98-a16a-41a4-8874-9eb1fac972af', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 17:04:40 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Trying to clone 08122a98-a16a-41a4-8874-9eb1fac972af from image 7afddb82-049d-4cb0-9488-82066e4ce33b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]). {{(pid=85889) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 17:04:40 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 17:04:40 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Image download 20.69 MB at 20.69 MB/s Sep 17 17:04:40 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd31207-53bd-4a2b-825c-f0351e1732ba]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:04:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:40 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD Sep 17 17:04:40 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:41 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Temporary image 7afddb82-049d-4cb0-9488-82066e4ce33b is fetched for user c04c3957a5804a1dac3b141cae89109a. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f9d487-2b38-4d1f-b2fb-37acc6ad56a4]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:41 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD Sep 17 17:04:41 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:41 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1514426510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08122a98-a16a-41a4-8874-9eb1fac972af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5137a394ead4194bdb5d97e641b8ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:04:39Z,use_quota=True,user_id='c04c3957a5804a1dac3b141cae89109a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Creating volume 08122a98-a16a-41a4-8874-9eb1fac972af {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:04:41 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:04:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:41 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af 1073741824 Sep 17 17:04:41 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:42 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af 1073741824" returned: 0 in 0.559s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:42 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af Sep 17 17:04:42 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:42 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af" returned: 0 in 0.279s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:04:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:42 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Attempting download of 7afddb82-049d-4cb0-9488-82066e4ce33b ((None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}])) to volume 08122a98-a16a-41a4-8874-9eb1fac972af. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 17:04:42 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6de532c-5b3c-4443-96f3-52fc0bc24cad]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:04:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_6yy0t2yo {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:42 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_6yy0t2yo Sep 17 17:04:42 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:43 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_6yy0t2yo" returned: 0 in 0.352s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_6yy0t2yo {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:43 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_6yy0t2yo Sep 17 17:04:43 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:43 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_6yy0t2yo" returned: 1 in 0.387s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_6yy0t2yo' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:04:43 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bd6c22-fb60-4f77-aef0-2c424612217e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:04:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:43 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD Sep 17 17:04:43 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:43 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:43 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] 7afddb82-049d-4cb0-9488-82066e4ce33b was qcow2, converting to qcow2 {{(pid=85889) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 17:04:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:43 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af Sep 17 17:04:43 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:46 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af" returned: 0 in 2.381s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_7jxsgpgudevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:04:46 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Converted 112.00 MB image at 46.98 MB/s Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:46 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af 1G Sep 17 17:04:46 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:46 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af 1G" returned: 0 in 0.427s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Downloaded image 7afddb82-049d-4cb0-9488-82066e4ce33b ((None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}])) to volume 08122a98-a16a-41a4-8874-9eb1fac972af successfully. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Temporary image 7afddb82-049d-4cb0-9488-82066e4ce33b for user c04c3957a5804a1dac3b141cae89109a is deleted. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Marking volume 08122a98-a16a-41a4-8874-9eb1fac972af as bootable. {{(pid=85889) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Copying metadata from image 7afddb82-049d-4cb0-9488-82066e4ce33b to 08122a98-a16a-41a4-8874-9eb1fac972af. {{(pid=85889) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Creating volume glance metadata for volume 08122a98-a16a-41a4-8874-9eb1fac972af backed by image 7afddb82-049d-4cb0-9488-82066e4ce33b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85889) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180c8bae-22e5-40dd-82d6-b22181ff79cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08122a98-a16a-41a4-8874-9eb1fac972af', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc425f5b-247b-4987-88dd-23634f12c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:04:46 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Volume volume-08122a98-a16a-41a4-8874-9eb1fac972af (08122a98-a16a-41a4-8874-9eb1fac972af): created successfully Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc425f5b-247b-4987-88dd-23634f12c654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:04:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Flow 'volume_create_manager' (16014d7f-d61b-4cd3-9f0d-a1a558add6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:04:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9606415c-0bf4-4569-9b11-1ead02b6dbff tempest-VolumesImageMetadata-124972987 None] Created volume successfully. Sep 17 17:04:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Acquiring lock "cinder-08122a98-a16a-41a4-8874-9eb1fac972af-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:04:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Lock "cinder-08122a98-a16a-41a4-8874-9eb1fac972af-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:04:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Acquiring lock "cinder-quobyte-08122a98-a16a-41a4-8874-9eb1fac972af" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:04:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Lock "cinder-quobyte-08122a98-a16a-41a4-8874-9eb1fac972af" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:04:48 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c910df83-27c5-4401-8b49-3fdaa0e12d26]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:04:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:49 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af Sep 17 17:04:49 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:49 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af" returned: 0 in 0.538s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:49 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af Sep 17 17:04:49 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:49 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-08122a98-a16a-41a4-8874-9eb1fac972af" returned: 0 in 0.456s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Lock "cinder-quobyte-08122a98-a16a-41a4-8874-9eb1fac972af" released by "delete_volume" :: held 1.065s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:04:50 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Created reservations ['f5885618-7c3b-4fd9-9582-74aab07508ee', 'f439de54-dc98-41d1-a739-2dc3e7b67ca3', '9a830802-2b1e-4b85-9c7c-96162e30e1d3', '88a7a7e2-6868-4e6c-baae-182e632c2645'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:04:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:04:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:04:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:04:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:04:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:04:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:04:50 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:04:50 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:04:50 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Sep 17 17:04:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.356s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:04:50 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:04:50 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Deleted volume successfully. Sep 17 17:04:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-915455ae-f6a2-4395-9ec0-a211800fd33a tempest-VolumesImageMetadata-124972987 None] Lock "cinder-08122a98-a16a-41a4-8874-9eb1fac972af-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:04:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-30ba74d4-15f8-4e37-bbe9-ab72bf206974 req-f4aa1452-d369-4183-b1fd-2c2ea389f042 tempest-ServerActionsTestOtherA-1009400035 None] Terminate volume connection completed successfully. Sep 17 17:04:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-30ba74d4-15f8-4e37-bbe9-ab72bf206974 req-f4aa1452-d369-4183-b1fd-2c2ea389f042 tempest-ServerActionsTestOtherA-1009400035 None] Deleting attachment 7ce52890-94a5-4bdc-b24d-590d5f705e46. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Flow 'volume_create_manager' (0b4e2ba2-c5ba-422c-b38e-6bfc23b7107a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54fa0e5-c5fb-44f5-aac9-c367714ea9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54fa0e5-c5fb-44f5-aac9-c367714ea9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1626892231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea900112-6f08-4ee1-8064-831e02fb4849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f368cc51bc45ab87160b43b7c361cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:00Z,use_quota=True,user_id='e344580b709f415da2caadd66f21afff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdc05ce-b733-49d6-8baa-78c306f6c5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdc05ce-b733-49d6-8baa-78c306f6c5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1209a50a-69dd-43f4-b8e1-3ce28fe74701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1209a50a-69dd-43f4-b8e1-3ce28fe74701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea900112-6f08-4ee1-8064-831e02fb4849', 'volume_name': 'volume-ea900112-6f08-4ee1-8064-831e02fb4849', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4b897d-c5be-400f-afae-0e1aa4523d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4b897d-c5be-400f-afae-0e1aa4523d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e21be19-91e5-4124-a6a0-fc2572874b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:00 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Volume ea900112-6f08-4ee1-8064-831e02fb4849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea900112-6f08-4ee1-8064-831e02fb4849', 'volume_size': 1} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1626892231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea900112-6f08-4ee1-8064-831e02fb4849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f368cc51bc45ab87160b43b7c361cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:00Z,use_quota=True,user_id='e344580b709f415da2caadd66f21afff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Creating volume ea900112-6f08-4ee1-8064-831e02fb4849 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:05:00 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:05:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:00 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 1073741824 Sep 17 17:05:00 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:01 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 1073741824" returned: 0 in 1.075s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:01 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 Sep 17 17:05:01 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:02 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849" returned: 0 in 0.557s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:05:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e21be19-91e5-4124-a6a0-fc2572874b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea900112-6f08-4ee1-8064-831e02fb4849', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d040965-fb09-4d93-b04d-a26bdccdf79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:02 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Volume volume-ea900112-6f08-4ee1-8064-831e02fb4849 (ea900112-6f08-4ee1-8064-831e02fb4849): created successfully Sep 17 17:05:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d040965-fb09-4d93-b04d-a26bdccdf79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Flow 'volume_create_manager' (0b4e2ba2-c5ba-422c-b38e-6bfc23b7107a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d378659a-b6e1-48dc-9092-e1ecd28e3bf8 tempest-SnapshotMetadataTestJSON-1859700647 None] Created volume successfully. Sep 17 17:05:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Creating offline snapshot 7a763438-3043-421a-b1db-264af3f9e527 of volume ea900112-6f08-4ee1-8064-831e02fb4849 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:05:03 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaf93bf-5f33-4cf9-b034-0ad2a3635b95]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:03 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 Sep 17 17:05:03 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:04 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849" returned: 0 in 0.585s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:04 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 1G Sep 17 17:05:04 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:04 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 1G" returned: 0 in 0.542s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea900112-6f08-4ee1-8064-831e02fb4849 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:05 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea900112-6f08-4ee1-8064-831e02fb4849 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 Sep 17 17:05:05 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:05 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea900112-6f08-4ee1-8064-831e02fb4849 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527" returned: 0 in 0.875s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:05 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 is being set with open permissions: ugo+rw Sep 17 17:05:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:05 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 Sep 17 17:05:05 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:06 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527" returned: 0 in 0.576s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:06 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.info Sep 17 17:05:06 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:07 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.info" returned: 0 in 0.629s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:07 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.info is being set with open permissions: ugo+rw Sep 17 17:05:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:07 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.info Sep 17 17:05:07 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:07 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.info" returned: 0 in 0.516s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.999s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b6c8c432-7549-4119-91ee-8cef10d2aa7c tempest-SnapshotMetadataTestJSON-1859700647 None] Create snapshot completed successfully Sep 17 17:05:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Acquiring lock "cinder-7a763438-3043-421a-b1db-264af3f9e527-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "cinder-7a763438-3043-421a-b1db-264af3f9e527-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Acquiring lock "cinder-quobyte-ea900112-6f08-4ee1-8064-831e02fb4849" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "cinder-quobyte-ea900112-6f08-4ee1-8064-831e02fb4849" acquired by "delete_snapshot" :: waited 0.059s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Acquiring lock "cinder-quobyte-7a763438-3043-421a-b1db-264af3f9e527" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "cinder-quobyte-7a763438-3043-421a-b1db-264af3f9e527" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Deleting offline snapshot 7a763438-3043-421a-b1db-264af3f9e527 of volume ea900112-6f08-4ee1-8064-831e02fb4849 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:05:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] snapshot_file for this snap is: volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:05:10 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2ff7c6-66d1-459c-8ea1-1c2518f16777]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:10 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 Sep 17 17:05:10 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527" returned: 0 in 0.756s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea900112-6f08-4ee1-8064-831e02fb4849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:05:10 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:11 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3796e41c-1238-40aa-80f4-f9f2f1546c95]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:11 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 Sep 17 17:05:11 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:11 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849" returned: 0 in 0.891s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:12 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 Sep 17 17:05:12 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:12 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527" returned: 0 in 0.647s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:12 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527 Sep 17 17:05:12 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:12 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:05:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Flow 'volume_create_manager' (d9be7040-eb74-455a-80d8-a6967a5fc14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef4509c-540d-4ef9-8aa2-d613bfb9d34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef4509c-540d-4ef9-8aa2-d613bfb9d34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1964219856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2902cd-4335-414c-8ca5-99a3b8490376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6b1a814b78448aaa44e0a375d1ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:13Z,use_quota=True,user_id='5fefccf1ad6046beb0a9a05ca0f35c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c2f59d-3c9e-4f5e-b80e-6e25a2b9dd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c2f59d-3c9e-4f5e-b80e-6e25a2b9dd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58dcc4fb-5798-40f9-bcc9-d348a3bc741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.image.glance [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Creating Keystone auth plugin from conf {{(pid=85889) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 17:05:13 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849.7a763438-3043-421a-b1db-264af3f9e527" returned: 0 in 0.634s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "cinder-quobyte-7a763438-3043-421a-b1db-264af3f9e527" released by "_delete_snapshot" :: held 3.275s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "cinder-quobyte-ea900112-6f08-4ee1-8064-831e02fb4849" released by "delete_snapshot" :: held 3.319s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Created reservations ['ad2f981f-d16e-4cec-a7d7-09937b06f77c', 'ee303028-a22b-4f82-b5f4-7b7966eeae86', 'ca9411f4-beb9-4d27-a97f-584d6c8cb09d', 'f9c505d6-b563-4128-9feb-8c3cee478b3c'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58dcc4fb-5798-40f9-bcc9-d348a3bc741a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de2902cd-4335-414c-8ca5-99a3b8490376', 'volume_name': 'volume-de2902cd-4335-414c-8ca5-99a3b8490376', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085cf6f5-20e9-4054-864f-1a73328d408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085cf6f5-20e9-4054-864f-1a73328d408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cb3141-ddf1-4a50-8c2d-80d668b2b6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:13 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Volume de2902cd-4335-414c-8ca5-99a3b8490376: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de2902cd-4335-414c-8ca5-99a3b8490376', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Trying to clone de2902cd-4335-414c-8ca5-99a3b8490376 from image 7afddb82-049d-4cb0-9488-82066e4ce33b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]). {{(pid=85889) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 17:05:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Delete snapshot completed successfully. Sep 17 17:05:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfe4e347-19d5-4aba-8c20-d4b8a9b1973e tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "cinder-7a763438-3043-421a-b1db-264af3f9e527-delete_snapshot" released by "delete_snapshot" :: held 3.850s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 17:05:14 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Image download 20.69 MB at 20.69 MB/s Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d45efab-9d37-4da8-9509-70dd8de2b9a3]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Acquiring lock "cinder-ea900112-6f08-4ee1-8064-831e02fb4849-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "cinder-ea900112-6f08-4ee1-8064-831e02fb4849-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Acquiring lock "cinder-quobyte-ea900112-6f08-4ee1-8064-831e02fb4849" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "cinder-quobyte-ea900112-6f08-4ee1-8064-831e02fb4849" acquired by "delete_volume" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:14 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD Sep 17 17:05:14 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be2ba49-9ba2-40c8-86e4-93e46c91914b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:14 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 Sep 17 17:05:14 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:14 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD" returned: 0 in 0.619s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:14 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Temporary image 7afddb82-049d-4cb0-9488-82066e4ce33b is fetched for user 5fefccf1ad6046beb0a9a05ca0f35c04. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[73661f27-5a48-4340-ba99-14f80cec400c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:15 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD Sep 17 17:05:15 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:15 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849" returned: 0 in 0.701s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:15 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849 Sep 17 17:05:15 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:15 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD" returned: 0 in 0.603s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1964219856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2902cd-4335-414c-8ca5-99a3b8490376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d6b1a814b78448aaa44e0a375d1ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:13Z,use_quota=True,user_id='5fefccf1ad6046beb0a9a05ca0f35c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Creating volume de2902cd-4335-414c-8ca5-99a3b8490376 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:05:15 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:05:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:15 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 1073741824 Sep 17 17:05:15 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:16 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ea900112-6f08-4ee1-8064-831e02fb4849" returned: 0 in 0.683s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "cinder-quobyte-ea900112-6f08-4ee1-8064-831e02fb4849" released by "delete_volume" :: held 1.509s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Created reservations ['cf99b346-f83f-437c-bd9e-0ae94faabad1', 'fec7d39b-b2e1-4b21-aab0-f8a4876d168f', '06970e72-2630-4080-8635-d8ebc0e726af', 'c003ce35-d871-48b2-b8e0-4c5cf6de2860'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:16 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:05:16 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:16 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 1073741824" returned: 0 in 0.840s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:16 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 Sep 17 17:05:16 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:16 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.513s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:16 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:05:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Deleted volume successfully. Sep 17 17:05:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2449892b-413c-4d8c-b2ee-b0d6527534fb tempest-SnapshotMetadataTestJSON-1859700647 None] Lock "cinder-ea900112-6f08-4ee1-8064-831e02fb4849-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:17 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376" returned: 0 in 0.571s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:05:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:17 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Attempting download of 7afddb82-049d-4cb0-9488-82066e4ce33b ((None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}])) to volume de2902cd-4335-414c-8ca5-99a3b8490376. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 17:05:17 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6affe4ef-81c3-425d-b81b-9de198df6bad]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_kslk_1yc {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:17 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_kslk_1yc Sep 17 17:05:17 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:17 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_kslk_1yc" returned: 0 in 0.477s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_kslk_1yc {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:18 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_kslk_1yc Sep 17 17:05:18 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:18 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_kslk_1yc" returned: 1 in 0.555s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_kslk_1yc' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:05:18 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c80c61b-eaf9-4848-b3ac-ced8a9ef4835]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:18 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD Sep 17 17:05:18 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:19 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:19 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] 7afddb82-049d-4cb0-9488-82066e4ce33b was qcow2, converting to qcow2 {{(pid=85889) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 17:05:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:19 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 Sep 17 17:05:19 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:22 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376" returned: 0 in 3.117s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_vbb3ouzhdevstack@QuobyteHD, size 112.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:05:22 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Converted 112.00 MB image at 35.92 MB/s Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:22 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 1G Sep 17 17:05:22 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:22 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:05:22 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Flow 'volume_create_manager' (07105957-6b0d-4880-8a10-20f0e16fac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ee53d3-0ee1-46bd-bae6-d20f7dc5684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ee53d3-0ee1-46bd-bae6-d20f7dc5684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2110212236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdc8d70-674d-423c-bed5-66dc5e111950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6837cc4fa3b44429d46496ea6ce6dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:22Z,use_quota=True,user_id='a58d3c0118f545ca811d721b3c5ed227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c627a1-1a8a-4481-b3eb-2ee5d31e9b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c627a1-1a8a-4481-b3eb-2ee5d31e9b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e424a3b-ac9c-44ce-9fb8-0d4b66dd16d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e424a3b-ac9c-44ce-9fb8-0d4b66dd16d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fdc8d70-674d-423c-bed5-66dc5e111950', 'volume_name': 'volume-2fdc8d70-674d-423c-bed5-66dc5e111950', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106a8ec0-1982-4858-bb9a-eb0285346985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106a8ec0-1982-4858-bb9a-eb0285346985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840fb544-aaea-4e42-8244-a48bdcad393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:22 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Volume 2fdc8d70-674d-423c-bed5-66dc5e111950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fdc8d70-674d-423c-bed5-66dc5e111950', 'volume_size': 1} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2110212236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdc8d70-674d-423c-bed5-66dc5e111950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6837cc4fa3b44429d46496ea6ce6dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:22Z,use_quota=True,user_id='a58d3c0118f545ca811d721b3c5ed227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Creating volume 2fdc8d70-674d-423c-bed5-66dc5e111950 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:05:22 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:22 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950 1073741824 Sep 17 17:05:22 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:22 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.474s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:05:22 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 1G" returned: 0 in 0.648s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Downloaded image 7afddb82-049d-4cb0-9488-82066e4ce33b ((None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}])) to volume de2902cd-4335-414c-8ca5-99a3b8490376 successfully. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Temporary image 7afddb82-049d-4cb0-9488-82066e4ce33b for user 5fefccf1ad6046beb0a9a05ca0f35c04 is deleted. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Marking volume de2902cd-4335-414c-8ca5-99a3b8490376 as bootable. {{(pid=85889) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Copying metadata from image 7afddb82-049d-4cb0-9488-82066e4ce33b to de2902cd-4335-414c-8ca5-99a3b8490376. {{(pid=85889) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 17:05:22 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Creating volume glance metadata for volume de2902cd-4335-414c-8ca5-99a3b8490376 backed by image 7afddb82-049d-4cb0-9488-82066e4ce33b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85889) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cb3141-ddf1-4a50-8c2d-80d668b2b6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2902cd-4335-414c-8ca5-99a3b8490376', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81194d04-201b-4f95-ad23-20df737c2db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:23 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Volume volume-de2902cd-4335-414c-8ca5-99a3b8490376 (de2902cd-4335-414c-8ca5-99a3b8490376): created successfully Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81194d04-201b-4f95-ad23-20df737c2db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Flow 'volume_create_manager' (d9be7040-eb74-455a-80d8-a6967a5fc14f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:23 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a8ee8c26-ad11-4476-bc4c-b8feb558eafc tempest-ServerActionsTestOtherA-1009400035 None] Created volume successfully. Sep 17 17:05:23 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950 1073741824" returned: 0 in 0.759s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:23 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950 Sep 17 17:05:23 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:23 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950" returned: 0 in 0.288s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840fb544-aaea-4e42-8244-a48bdcad393f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fdc8d70-674d-423c-bed5-66dc5e111950', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede33b91-1b60-45d0-bf14-444a6b0e1395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:23 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Volume volume-2fdc8d70-674d-423c-bed5-66dc5e111950 (2fdc8d70-674d-423c-bed5-66dc5e111950): created successfully Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede33b91-1b60-45d0-bf14-444a6b0e1395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Flow 'volume_create_manager' (07105957-6b0d-4880-8a10-20f0e16fac4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:23 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-23de416e-a87c-42d1-a286-b98d138ca4e1 tempest-ServerRescueNegativeTestJSON-1901425639 None] Created volume successfully. Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Flow 'volume_create_manager' (5324faf0-93b4-4855-a45c-eb2cb389e104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b0e40f-b622-4fa9-beb4-a8edaded0b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b0e40f-b622-4fa9-beb4-a8edaded0b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-131138268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c18c73-4963-4c5a-bf70-060f13fc5e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f6299163534e75bff559f78d844ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:25Z,use_quota=True,user_id='891d351f793e452588282d38f9c1c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3642e3bf-11bc-4252-bd79-ff00d17f8954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3642e3bf-11bc-4252-bd79-ff00d17f8954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343c4176-ac0d-47a4-80e9-a626517fc843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343c4176-ac0d-47a4-80e9-a626517fc843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c18c73-4963-4c5a-bf70-060f13fc5e2d', 'volume_name': 'volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce38ebd4-7836-491b-8d30-7939e337cf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce38ebd4-7836-491b-8d30-7939e337cf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84f9571-8a2e-4a2c-9988-a89ede0c76aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:25 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Volume 58c18c73-4963-4c5a-bf70-060f13fc5e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d', 'volume_size': 1} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-131138268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c18c73-4963-4c5a-bf70-060f13fc5e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f6299163534e75bff559f78d844ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:25Z,use_quota=True,user_id='891d351f793e452588282d38f9c1c8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Creating volume 58c18c73-4963-4c5a-bf70-060f13fc5e2d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:05:25 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:05:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:25 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d 1073741824 Sep 17 17:05:25 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:26 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d 1073741824" returned: 0 in 0.965s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:26 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d Sep 17 17:05:26 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:26 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d" returned: 0 in 0.515s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:05:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84f9571-8a2e-4a2c-9988-a89ede0c76aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413647d7-0a66-4b94-96c3-0999b6cd95e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:26 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Volume volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d (58c18c73-4963-4c5a-bf70-060f13fc5e2d): created successfully Sep 17 17:05:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413647d7-0a66-4b94-96c3-0999b6cd95e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Flow 'volume_create_manager' (5324faf0-93b4-4855-a45c-eb2cb389e104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:26 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-cde4982c-59e1-43ac-b880-920573a3ac2c tempest-AttachVolumeNegativeTest-1298711111 None] Created volume successfully. Sep 17 17:05:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6df1ed2b-9334-4388-8e50-e2f3c8f1752e req-08ab487c-55e2-4446-a7c9-b6ff9306f218 tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6df1ed2b-9334-4388-8e50-e2f3c8f1752e req-08ab487c-55e2-4446-a7c9-b6ff9306f218 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6df1ed2b-9334-4388-8e50-e2f3c8f1752e req-08ab487c-55e2-4446-a7c9-b6ff9306f218 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-6df1ed2b-9334-4388-8e50-e2f3c8f1752e req-08ab487c-55e2-4446-a7c9-b6ff9306f218 tempest-AttachVolumeNegativeTest-1298711111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dc1f063-a9c2-47fe-854d-dc1eb0f4ef7d', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:05:29 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-6df1ed2b-9334-4388-8e50-e2f3c8f1752e req-08ab487c-55e2-4446-a7c9-b6ff9306f218 tempest-AttachVolumeNegativeTest-1298711111 None] attachment_update completed successfully. Sep 17 17:05:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-4888cea2-e7ab-4368-a5e6-73770204c607 req-d2c0cf7a-c083-4e0a-a8bc-0af0c58664e9 tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-4888cea2-e7ab-4368-a5e6-73770204c607 req-d2c0cf7a-c083-4e0a-a8bc-0af0c58664e9 tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-4888cea2-e7ab-4368-a5e6-73770204c607 req-d2c0cf7a-c083-4e0a-a8bc-0af0c58664e9 tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-4888cea2-e7ab-4368-a5e6-73770204c607 req-d2c0cf7a-c083-4e0a-a8bc-0af0c58664e9 tempest-ServerActionsTestOtherA-1009400035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-de2902cd-4335-414c-8ca5-99a3b8490376', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32f8ad76-4b5a-42b8-b33e-8398660222ea', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:05:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-4888cea2-e7ab-4368-a5e6-73770204c607 req-d2c0cf7a-c083-4e0a-a8bc-0af0c58664e9 tempest-ServerActionsTestOtherA-1009400035 None] attachment_update completed successfully. Sep 17 17:05:33 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=74,cinder:UPDATE=50,cinder:INSERT=26,cinder:DELETE=4 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:05:33 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=48,cinder:SELECT=64,cinder:DELETE=5,cinder:INSERT=19 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:05:33 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-8569c5c3-8d71-4435-96ca-8081dd5e9a3b req-1c3a9a0c-616b-4331-a538-44d2755846fb tempest-AttachVolumeNegativeTest-1298711111 None] Terminate volume connection completed successfully. Sep 17 17:05:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-8569c5c3-8d71-4435-96ca-8081dd5e9a3b req-1c3a9a0c-616b-4331-a538-44d2755846fb tempest-AttachVolumeNegativeTest-1298711111 None] Deleting attachment 3dc1f063-a9c2-47fe-854d-dc1eb0f4ef7d. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Flow 'volume_create_manager' (707f3c92-e228-4640-9656-a01673f294a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1d4d8f-087c-44b4-ad1c-639bbed48ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1d4d8f-087c-44b4-ad1c-639bbed48ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1672454193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82944bfb-80ef-4b3c-b1c1-0b56e773a968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b636c28974d4ec983405fffb69e6e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:34Z,use_quota=True,user_id='b5926928de2747a486adea7325a50760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b1be91-4f31-4753-b0df-2d6a7cce80f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b1be91-4f31-4753-b0df-2d6a7cce80f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f02752-54a2-47d1-bf1b-6fafc04cbf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f02752-54a2-47d1-bf1b-6fafc04cbf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82944bfb-80ef-4b3c-b1c1-0b56e773a968', 'volume_name': 'volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9657c36c-3723-4d2b-92db-965abd55972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9657c36c-3723-4d2b-92db-965abd55972b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9b0d43-3617-4859-9ff0-6b03a54ffca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:34 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Volume 82944bfb-80ef-4b3c-b1c1-0b56e773a968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968', 'volume_size': 1} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1672454193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82944bfb-80ef-4b3c-b1c1-0b56e773a968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b636c28974d4ec983405fffb69e6e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:34Z,use_quota=True,user_id='b5926928de2747a486adea7325a50760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Creating volume 82944bfb-80ef-4b3c-b1c1-0b56e773a968 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:05:34 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:05:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:34 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968 1073741824 Sep 17 17:05:34 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:35 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968 1073741824" returned: 0 in 0.962s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:35 devstack sudo[91942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968 Sep 17 17:05:35 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968" returned: 0 in 0.794s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:05:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:36 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9b0d43-3617-4859-9ff0-6b03a54ffca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfebcc2e-879f-480b-b8da-71c5d0e3bacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:36 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Volume volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968 (82944bfb-80ef-4b3c-b1c1-0b56e773a968): created successfully Sep 17 17:05:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfebcc2e-879f-480b-b8da-71c5d0e3bacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Flow 'volume_create_manager' (707f3c92-e228-4640-9656-a01673f294a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:36 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-14d1a4f4-c342-48ef-ad16-36640971601c tempest-VolumesTransfersTest-39462384 None] Created volume successfully. Sep 17 17:05:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Acquiring lock "cinder-2fdc8d70-674d-423c-bed5-66dc5e111950-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Lock "cinder-2fdc8d70-674d-423c-bed5-66dc5e111950-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Acquiring lock "cinder-quobyte-2fdc8d70-674d-423c-bed5-66dc5e111950" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Lock "cinder-quobyte-2fdc8d70-674d-423c-bed5-66dc5e111950" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:38 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[12000794-ba6c-47c2-a960-e71e1c96af90]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:38 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950 Sep 17 17:05:38 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:38 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950" returned: 0 in 0.733s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:38 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950 Sep 17 17:05:38 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:39 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2fdc8d70-674d-423c-bed5-66dc5e111950" returned: 0 in 0.343s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Lock "cinder-quobyte-2fdc8d70-674d-423c-bed5-66dc5e111950" released by "delete_volume" :: held 1.198s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:39 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Created reservations ['095c74dc-8500-4ea0-832d-971804dbfbd8', 'ea3137d7-862b-4b2b-b36c-d6de6c723348', '02c74f16-cc74-429c-a015-01686f20c1aa', '95078b15-2407-43e9-a132-7f6cc0618988'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:05:39 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9009b953-ce93-42b8-af04-fc69ddb50454 tempest-VolumesTransfersTest-1110048422 None] Transfer volume completed successfully. Sep 17 17:05:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:39 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:05:39 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:40 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.529s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:40 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:05:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Deleted volume successfully. Sep 17 17:05:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cf8de613-e872-47d9-8eba-e72e48a4228e tempest-ServerRescueNegativeTestJSON-1901425639 None] Lock "cinder-2fdc8d70-674d-423c-bed5-66dc5e111950-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Acquiring lock "cinder-82944bfb-80ef-4b3c-b1c1-0b56e773a968-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Lock "cinder-82944bfb-80ef-4b3c-b1c1-0b56e773a968-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Acquiring lock "cinder-quobyte-82944bfb-80ef-4b3c-b1c1-0b56e773a968" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Lock "cinder-quobyte-82944bfb-80ef-4b3c-b1c1-0b56e773a968" acquired by "delete_volume" :: waited 0.075s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:42 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b9f12-b941-47b7-9e7b-dab727b98cbe]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:42 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968 Sep 17 17:05:42 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:43 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968" returned: 0 in 0.857s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:43 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968 Sep 17 17:05:43 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:43 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-82944bfb-80ef-4b3c-b1c1-0b56e773a968" returned: 0 in 0.671s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Lock "cinder-quobyte-82944bfb-80ef-4b3c-b1c1-0b56e773a968" released by "delete_volume" :: held 1.697s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:43 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Created reservations ['c9585905-6fb6-4b17-ab4c-633b38009143', 'a860a69a-37de-463a-af21-8811f2127041', '06a0ef8f-8711-4366-8ded-d9b5b4527c1e', 'e45a9778-e1b0-47ac-b93b-3be8c2252efc'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:05:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:44 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:05:44 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:44 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.749s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:44 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:05:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Deleted volume successfully. Sep 17 17:05:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a862b7ee-6561-4b80-8ffe-c86fc4bd8a35 tempest-VolumesTransfersTest-410070254 None] Lock "cinder-82944bfb-80ef-4b3c-b1c1-0b56e773a968-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Flow 'volume_create_manager' (4cc3e913-fa96-4086-958f-3378e8739c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44c1460-439d-4673-9f20-2b79ec28dcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44c1460-439d-4673-9f20-2b79ec28dcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-848168272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d7532f-6a56-45c4-8a59-4280cd3ca747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b636c28974d4ec983405fffb69e6e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:46Z,use_quota=True,user_id='b5926928de2747a486adea7325a50760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093cf473-85b7-4bc3-a064-0e9150f504f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093cf473-85b7-4bc3-a064-0e9150f504f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9214d6d0-433e-4f28-9c9d-126c2ec7574c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9214d6d0-433e-4f28-9c9d-126c2ec7574c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d7532f-6a56-45c4-8a59-4280cd3ca747', 'volume_name': 'volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8aa681-064d-4204-ae15-9442bfead28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8aa681-064d-4204-ae15-9442bfead28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e799a5-ed13-4a4e-a727-86b9b16c7953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:46 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Volume d7d7532f-6a56-45c4-8a59-4280cd3ca747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747', 'volume_size': 1} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-848168272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d7532f-6a56-45c4-8a59-4280cd3ca747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b636c28974d4ec983405fffb69e6e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:05:46Z,use_quota=True,user_id='b5926928de2747a486adea7325a50760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Creating volume d7d7532f-6a56-45c4-8a59-4280cd3ca747 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:05:46 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:46 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747 1073741824 Sep 17 17:05:46 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "cinder-58c18c73-4963-4c5a-bf70-060f13fc5e2d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-58c18c73-4963-4c5a-bf70-060f13fc5e2d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "cinder-quobyte-58c18c73-4963-4c5a-bf70-060f13fc5e2d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-quobyte-58c18c73-4963-4c5a-bf70-060f13fc5e2d" acquired by "delete_volume" :: waited 0.044s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ed2166-3304-40b0-be60-cdff3afec760]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:46 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d Sep 17 17:05:46 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:47 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747 1073741824" returned: 0 in 1.016s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:47 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747 Sep 17 17:05:47 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:47 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d" returned: 0 in 0.867s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:47 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d Sep 17 17:05:47 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:47 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747" returned: 0 in 0.651s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:05:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e799a5-ed13-4a4e-a727-86b9b16c7953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc141ea8-2e12-469d-9b47-01f914a60577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:05:48 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Volume volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747 (d7d7532f-6a56-45c4-8a59-4280cd3ca747): created successfully Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc141ea8-2e12-469d-9b47-01f914a60577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Flow 'volume_create_manager' (4cc3e913-fa96-4086-958f-3378e8739c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:05:48 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5f8da441-090f-475b-b31c-c4ee0f78026b tempest-VolumesTransfersTest-39462384 None] Created volume successfully. Sep 17 17:05:48 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-58c18c73-4963-4c5a-bf70-060f13fc5e2d" returned: 0 in 0.886s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-quobyte-58c18c73-4963-4c5a-bf70-060f13fc5e2d" released by "delete_volume" :: held 1.858s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Created reservations ['818ef00d-3e82-47ca-beff-f26f028f8c15', 'b9adaae5-007d-4437-83c4-bcf71c889231', '7c2e2168-3af4-4a25-835f-ca3b21801671', '42a57c6e-1273-43d9-ba9c-03651a2e4a44'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:48 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:05:48 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:49 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Acquiring lock "cinder-d7d7532f-6a56-45c4-8a59-4280cd3ca747-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.870s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:05:49 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Deleted volume successfully. Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Lock "cinder-d7d7532f-6a56-45c4-8a59-4280cd3ca747-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "cinder-d383f769-167b-49c0-9a5d-0a1a15f7f45f-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-af20fd03-e90d-4c67-a357-ab4ec15d49f5 tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-58c18c73-4963-4c5a-bf70-060f13fc5e2d-delete_volume" released by "delete_volume" :: held 3.378s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-d383f769-167b-49c0-9a5d-0a1a15f7f45f-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Acquiring lock "cinder-quobyte-d7d7532f-6a56-45c4-8a59-4280cd3ca747" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Lock "cinder-quobyte-d7d7532f-6a56-45c4-8a59-4280cd3ca747" acquired by "delete_volume" :: waited 0.047s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "cinder-quobyte-d383f769-167b-49c0-9a5d-0a1a15f7f45f" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[92066a20-ea51-4e5d-8749-12cb540a8fd2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-quobyte-d383f769-167b-49c0-9a5d-0a1a15f7f45f" acquired by "delete_volume" :: waited 0.057s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b147a270-e1b3-40d8-8516-3125989ed919]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:50 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747 Sep 17 17:05:50 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:50 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f Sep 17 17:05:50 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:50 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747" returned: 0 in 0.672s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:50 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747 Sep 17 17:05:50 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:50 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d7d7532f-6a56-45c4-8a59-4280cd3ca747" returned: 0 in 0.404s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Lock "cinder-quobyte-d7d7532f-6a56-45c4-8a59-4280cd3ca747" released by "delete_volume" :: held 1.188s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Created reservations ['0fa98413-86a4-4e6b-b0a2-17860fb3dd19', '628187bd-8839-4136-b0ce-08e575592d50', '40d664b4-a275-4621-b0f8-4eaa31562517', 'e9764ed7-3b41-438a-9a65-8d000c6ccf83'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:05:51 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f" returned: 0 in 1.172s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:51 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f Sep 17 17:05:51 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:51 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:05:51 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:51 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d383f769-167b-49c0-9a5d-0a1a15f7f45f" returned: 0 in 0.565s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-quobyte-d383f769-167b-49c0-9a5d-0a1a15f7f45f" released by "delete_volume" :: held 1.835s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:51 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.569s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:05:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Deleted volume successfully. Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Created reservations ['0b44ad08-cf58-4b65-af49-b1e036876b0d', '1c746ff9-a3b9-4311-aa54-b03f4da00494', '7e015925-e696-400d-82a5-4d1552bdf6b4', 'daa25e1e-dce3-46b8-a28d-16b7aac5838e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:05:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-86b3cfb7-ff98-4efb-bd24-0c5b4a7b3928 tempest-VolumesTransfersTest-410070254 None] Lock "cinder-d7d7532f-6a56-45c4-8a59-4280cd3ca747-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:52 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:05:52 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:52 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.352s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:05:52 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Deleted volume successfully. Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e1baa72-eed4-46de-b778-0f86496960bc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-d383f769-167b-49c0-9a5d-0a1a15f7f45f-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "cinder-c4adc120-0f97-4cca-a999-a4e87eadb69b-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-c4adc120-0f97-4cca-a999-a4e87eadb69b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "cinder-quobyte-c4adc120-0f97-4cca-a999-a4e87eadb69b" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:05:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-quobyte-c4adc120-0f97-4cca-a999-a4e87eadb69b" acquired by "delete_volume" :: waited 0.039s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:05:53 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99c5e5f-7ba6-444e-b241-2da9cdf8b5b1]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:05:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:53 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b Sep 17 17:05:53 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:53 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b" returned: 0 in 0.535s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:53 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b Sep 17 17:05:53 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:54 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c4adc120-0f97-4cca-a999-a4e87eadb69b" returned: 0 in 0.554s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-quobyte-c4adc120-0f97-4cca-a999-a4e87eadb69b" released by "delete_volume" :: held 1.166s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Created reservations ['2d0df380-420d-403a-9997-0bbb3f034930', 'fd76d094-d13b-4ea7-ba56-1170f26d96e5', 'c5ab56d6-335f-4744-9724-c1b087f50013', 'ad0819c5-a6fc-447e-ac06-f0e07b9a822d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:05:54 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:05:54 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:05:54 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.496s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:05:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Deleted volume successfully. Sep 17 17:05:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e37380f-9166-48f4-872e-23371fcc6dbc tempest-AttachVolumeNegativeTest-1298711111 None] Lock "cinder-c4adc120-0f97-4cca-a999-a4e87eadb69b-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-ca2cfc75-e576-4af2-81b4-687904ee3dea req-a6b81e3a-fbda-4fe1-9446-68adacfdc340 tempest-ServerActionsTestOtherA-1009400035 None] Terminate volume connection completed successfully. Sep 17 17:06:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-ca2cfc75-e576-4af2-81b4-687904ee3dea req-a6b81e3a-fbda-4fe1-9446-68adacfdc340 tempest-ServerActionsTestOtherA-1009400035 None] Deleting attachment 32f8ad76-4b5a-42b8-b33e-8398660222ea. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:06:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-ca2cfc75-e576-4af2-81b4-687904ee3dea req-7db0bc97-65e7-4c8e-b589-45937aa670f7 tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-ca2cfc75-e576-4af2-81b4-687904ee3dea req-7db0bc97-65e7-4c8e-b589-45937aa670f7 tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-ca2cfc75-e576-4af2-81b4-687904ee3dea req-7db0bc97-65e7-4c8e-b589-45937aa670f7 tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-ca2cfc75-e576-4af2-81b4-687904ee3dea req-7db0bc97-65e7-4c8e-b589-45937aa670f7 tempest-ServerActionsTestOtherA-1009400035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-de2902cd-4335-414c-8ca5-99a3b8490376', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a150a6a-a305-45ac-a444-8b574157089b', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:06:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-ca2cfc75-e576-4af2-81b4-687904ee3dea req-7db0bc97-65e7-4c8e-b589-45937aa670f7 tempest-ServerActionsTestOtherA-1009400035 None] attachment_update completed successfully. Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Flow 'volume_create_manager' (bcc3df69-d7f8-428e-ba32-517a93027f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da408ad-ff7e-415e-84cc-38ef161e1795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da408ad-ff7e-415e-84cc-38ef161e1795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-749403418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee73ff7d-e3fd-4a07-a013-88a932435dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9269116c6484fa88b3071bfb92ecda1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:06:09Z,use_quota=True,user_id='5f5c9b09584545b7be7dddf2c4d19fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e65524f-7bc9-49b3-83ad-d7454262ca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e65524f-7bc9-49b3-83ad-d7454262ca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa5ea9a-ecd4-451a-93df-9014ce9f629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa5ea9a-ecd4-451a-93df-9014ce9f629e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee73ff7d-e3fd-4a07-a013-88a932435dd0', 'volume_name': 'volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee5b55e-5bcf-4a8d-993a-f592eaf75179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee5b55e-5bcf-4a8d-993a-f592eaf75179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e49897-1a91-4987-af4f-ea7ed5c6dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:09 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Volume ee73ff7d-e3fd-4a07-a013-88a932435dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0', 'volume_size': 1} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-749403418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee73ff7d-e3fd-4a07-a013-88a932435dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9269116c6484fa88b3071bfb92ecda1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:06:09Z,use_quota=True,user_id='5f5c9b09584545b7be7dddf2c4d19fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Creating volume ee73ff7d-e3fd-4a07-a013-88a932435dd0 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:06:09 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:06:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:09 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0 1073741824 Sep 17 17:06:09 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a5dbcea6-c3a8-4c74-a012-d0304bd84463 tempest-GroupSnapshotsTest-1295499239 None] Group tempest-GroupSnapshotsTest-Group-689040008: creating Sep 17 17:06:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a5dbcea6-c3a8-4c74-a012-d0304bd84463 tempest-GroupSnapshotsTest-1295499239 None] Group tempest-GroupSnapshotsTest-Group-689040008: created successfully Sep 17 17:06:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a5dbcea6-c3a8-4c74-a012-d0304bd84463 tempest-GroupSnapshotsTest-1295499239 None] Create group completed successfully. Sep 17 17:06:10 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0 1073741824" returned: 0 in 0.847s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:10 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0 Sep 17 17:06:10 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:10 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0" returned: 0 in 0.338s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:06:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e49897-1a91-4987-af4f-ea7ed5c6dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653f20e7-cbc6-400a-83a5-ce3fa70e439d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:10 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Volume volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0 (ee73ff7d-e3fd-4a07-a013-88a932435dd0): created successfully Sep 17 17:06:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653f20e7-cbc6-400a-83a5-ce3fa70e439d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Flow 'volume_create_manager' (bcc3df69-d7f8-428e-ba32-517a93027f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:06:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d17fdc07-8c5a-492e-9ced-784609d944f4 tempest-VolumesTransfersV355Test-2026255038 None] Created volume successfully. Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Flow 'volume_create_manager' (10023d91-a0d4-4a16-b2b5-9797b4a31278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e043899a-f6e9-470c-9e8b-01b528f0f76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e043899a-f6e9-470c-9e8b-01b528f0f76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-191951308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b71f4bd-8fda-4595-b6ab-107549c06131,host='devstack@QuobyteHD#QuobyteHD',id=57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e6affb477448cabf87c415e48166c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:06:12Z,use_quota=True,user_id='149d0d66ab2247baa15756aba759b9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98ba52be-3a72-49b1-8c0a-3f4ca886508a),volume_type_id=98ba52be-3a72-49b1-8c0a-3f4ca886508a)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3d3f71-26df-4caf-90d3-91f8600e478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3d3f71-26df-4caf-90d3-91f8600e478a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fa49ad-1d74-4479-a56d-ff513d7ec68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fa49ad-1d74-4479-a56d-ff513d7ec68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70', 'volume_name': 'volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc1924f-69cf-45d9-a89d-5c95364441f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc1924f-69cf-45d9-a89d-5c95364441f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42eb913-56fb-4adb-adbf-01018662604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:12 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Volume 57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70', 'volume_size': 1} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b71f4bd-8fda-4595-b6ab-107549c06131,created_at=2026-09-17T15:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-191951308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b71f4bd-8fda-4595-b6ab-107549c06131,host='devstack@QuobyteHD#QuobyteHD',id=57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e6affb477448cabf87c415e48166c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:06:12Z,use_quota=True,user_id='149d0d66ab2247baa15756aba759b9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98ba52be-3a72-49b1-8c0a-3f4ca886508a),volume_type_id=98ba52be-3a72-49b1-8c0a-3f4ca886508a)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Creating volume 57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:06:12 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:06:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:12 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 1073741824 Sep 17 17:06:12 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5de0bb1f-eb79-4da4-ad10-542a9309813a tempest-VolumesTransfersV355Test-1540245179 None] Transfer volume completed successfully. Sep 17 17:06:13 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 1073741824" returned: 0 in 1.131s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:13 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 Sep 17 17:06:13 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Acquiring lock "cinder-ee73ff7d-e3fd-4a07-a013-88a932435dd0-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:14 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Lock "cinder-ee73ff7d-e3fd-4a07-a013-88a932435dd0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" returned: 0 in 0.390s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42eb913-56fb-4adb-adbf-01018662604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d091ec-e286-4e31-abce-65721b890f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:14 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Volume volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 (57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70): created successfully Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d091ec-e286-4e31-abce-65721b890f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Flow 'volume_create_manager' (10023d91-a0d4-4a16-b2b5-9797b4a31278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:06:14 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-354bff5e-0a10-4807-b4d4-040c0b2df14a tempest-GroupSnapshotsTest-1295499239 None] Created volume successfully. Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Acquiring lock "cinder-quobyte-ee73ff7d-e3fd-4a07-a013-88a932435dd0" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Lock "cinder-quobyte-ee73ff7d-e3fd-4a07-a013-88a932435dd0" acquired by "delete_volume" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecac19c9-7c87-46a5-abd8-e7d513bab058]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:14 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0 Sep 17 17:06:14 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:14 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0" returned: 0 in 0.477s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:14 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0 Sep 17 17:06:14 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:15 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ee73ff7d-e3fd-4a07-a013-88a932435dd0" returned: 0 in 0.504s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Lock "cinder-quobyte-ee73ff7d-e3fd-4a07-a013-88a932435dd0" released by "delete_volume" :: held 1.062s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:15 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] GroupSnapshot 34f1605f-4171-4b0d-86a0-ba4683594918: creating. Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Created reservations ['3845aef1-464e-4e61-a8d2-0ba9fa312b17', '23db5b79-26bc-4f42-81d0-315fe1ab4602', 'd2302b06-78eb-439a-b2cc-2ba67c661f4a', '0d403619-96a3-4349-a031-a0818263aba8'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Group snapshot 34f1605f-4171-4b0d-86a0-ba4683594918: creating. {{(pid=85889) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Creating offline snapshot ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 of volume 57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6966dfe-ebe4-419f-95d5-17a40071f692]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:15 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:06:15 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:15 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 Sep 17 17:06:15 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:15 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.289s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:06:15 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Deleted volume successfully. Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d17eb9f8-b889-4b1c-9897-098a2c4c7ef9 tempest-VolumesTransfersV355Test-1890159016 None] Lock "cinder-ee73ff7d-e3fd-4a07-a013-88a932435dd0-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:15 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" returned: 0 in 0.460s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:15 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 1G Sep 17 17:06:15 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:16 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 1G" returned: 0 in 0.550s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:16 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 Sep 17 17:06:16 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:16 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4" returned: 0 in 0.383s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:16 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:06:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:16 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 Sep 17 17:06:16 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:06:17 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Flow 'volume_create_manager' (eee6d473-b8e1-419e-b609-acfb1ec92860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2369284e-9f8d-472b-b291-e5991edd9683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4" returned: 0 in 0.377s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2369284e-9f8d-472b-b291-e5991edd9683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1610983046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a763052f-f6d8-42ed-9114-d69104d6956b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9269116c6484fa88b3071bfb92ecda1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:06:17Z,use_quota=True,user_id='5f5c9b09584545b7be7dddf2c4d19fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce92881-573b-44a0-9893-267cc47d1f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce92881-573b-44a0-9893-267cc47d1f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18db2146-f546-429b-be9c-8eba06a04f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18db2146-f546-429b-be9c-8eba06a04f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a763052f-f6d8-42ed-9114-d69104d6956b', 'volume_name': 'volume-a763052f-f6d8-42ed-9114-d69104d6956b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60989af5-6b6b-4c2b-9324-eccffa609dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60989af5-6b6b-4c2b-9324-eccffa609dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c19498b-b95b-4646-9d31-cb6428f0cb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:17 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Volume a763052f-f6d8-42ed-9114-d69104d6956b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a763052f-f6d8-42ed-9114-d69104d6956b', 'volume_size': 1} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:17 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.info Sep 17 17:06:17 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:17 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.info" returned: 0 in 0.400s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:17 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:06:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:17 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.info Sep 17 17:06:17 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:18 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.info" returned: 0 in 0.520s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.847s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1610983046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a763052f-f6d8-42ed-9114-d69104d6956b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9269116c6484fa88b3071bfb92ecda1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:06:17Z,use_quota=True,user_id='5f5c9b09584545b7be7dddf2c4d19fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Creating volume a763052f-f6d8-42ed-9114-d69104d6956b {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:06:18 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:06:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:18 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b 1073741824 Sep 17 17:06:18 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:18 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ba7ecb4b-9a80-433d-963a-6e848a95482c tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 34f1605f-4171-4b0d-86a0-ba4683594918: created successfully Sep 17 17:06:19 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b 1073741824" returned: 0 in 0.744s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:19 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b Sep 17 17:06:19 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:19 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b" returned: 0 in 0.362s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c19498b-b95b-4646-9d31-cb6428f0cb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a763052f-f6d8-42ed-9114-d69104d6956b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c084d8b-3033-43f1-9ec5-937233a79c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:19 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Volume volume-a763052f-f6d8-42ed-9114-d69104d6956b (a763052f-f6d8-42ed-9114-d69104d6956b): created successfully Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c084d8b-3033-43f1-9ec5-937233a79c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Flow 'volume_create_manager' (eee6d473-b8e1-419e-b609-acfb1ec92860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:06:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-fefbccfd-ab0c-45ba-9797-3f11807d57ba tempest-VolumesTransfersV355Test-2026255038 None] Created volume successfully. Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-ba7c7dec-c715-4bcb-b05c-f4bd655d1df4-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" by "_create_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-ba7c7dec-c715-4bcb-b05c-f4bd655d1df4-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Creating volume 5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa from snapshot ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 {{(pid=85889) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] snapshot: ba7c7dec-c715-4bcb-b05c-f4bd655d1df4, volume: 5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:20 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d7765e-c16b-4c2e-bc90-e6d4d86ad0e6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:20 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 Sep 17 17:06:20 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:20 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4" returned: 0 in 0.932s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:06:20 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcb722b-b1fb-41b7-85e9-b41acd38ffd6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:21 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 Sep 17 17:06:21 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Acquiring lock "cinder-a763052f-f6d8-42ed-9114-d69104d6956b-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Lock "cinder-a763052f-f6d8-42ed-9114-d69104d6956b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Acquiring lock "cinder-quobyte-a763052f-f6d8-42ed-9114-d69104d6956b" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Lock "cinder-quobyte-a763052f-f6d8-42ed-9114-d69104d6956b" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff90de0-4765-472e-98bf-fc00c8e7457f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:21 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" returned: 0 in 0.673s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:06:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:21 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa Sep 17 17:06:21 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:21 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b Sep 17 17:06:21 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:22 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b" returned: 0 in 0.507s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:22 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b Sep 17 17:06:22 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:22 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:06:22 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:22 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a763052f-f6d8-42ed-9114-d69104d6956b" returned: 0 in 0.363s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Lock "cinder-quobyte-a763052f-f6d8-42ed-9114-d69104d6956b" released by "delete_volume" :: held 0.961s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Created reservations ['34f444ff-31a2-4025-b3e9-19a52532245d', '94ca7001-c1b9-4a98-aff6-21f62ab946ff', '589fa3c4-50bf-4584-aeac-c8186e5b2d21', 'f3dc4f26-9de2-4b60-ad06-5d8dd63e3385'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:22 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:06:22 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:23 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.858s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:23 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:06:23 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:06:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:06:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:06:23 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.761s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:23 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:06:23 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Deleted volume successfully. Sep 17 17:06:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-00fa35ff-6455-4e76-abaa-7477d0969816 tempest-VolumesTransfersV355Test-1890159016 None] Lock "cinder-a763052f-f6d8-42ed-9114-d69104d6956b-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:31 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" returned: 0 in 9.640s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:31 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70, size 1024.00 MB, duration 9.64 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:06:31 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Converted 1024.00 MB image at 106.21 MB/s Sep 17 17:06:31 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:06:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:31 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa Sep 17 17:06:31 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:31 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" returned: 0 in 0.331s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" released by "_copy_volume_from_snapshot" :: held 11.716s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-ba7c7dec-c715-4bcb-b05c-f4bd655d1df4-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" released by "_create_volume_from_snapshot" :: held 11.828s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.856s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7a43e564-c255-4eca-b210-3fe62e676274 tempest-GroupSnapshotsTest-1295499239 None] Create group from source-snapshot-34f1605f-4171-4b0d-86a0-ba4683594918 completed successfully. Sep 17 17:06:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:33 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0785dad-31ae-47fc-a4c7-389ac5a86fba]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:33 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa Sep 17 17:06:33 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:34 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" returned: 0 in 0.987s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:34 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa Sep 17 17:06:34 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:35 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" returned: 0 in 0.700s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-5ffce41b-0bd6-4d53-8612-3fbd0a68a6aa" released by "delete_volume" :: held 1.825s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:35 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=69,cinder:UPDATE=93,cinder:INSERT=24,cinder:DELETE=5 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:06:35 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=81,cinder:SELECT=76,cinder:INSERT=15,cinder:DELETE=8 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:06:35 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['5db60dab-ac29-46f2-bd62-4090d8650391'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:06:35 devstack cinder-volume[85889]: WARNING cinder.quota [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1183667887 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1183667887, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:06:35 devstack cinder-volume[85889]: WARNING cinder.quota [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1183667887 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1183667887, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:06:35 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['a57270aa-0fc9-47b8-9f16-d11ce7af9b4d', '7d8560c6-9551-449b-9f75-7539e8f06ab4', '4f6fcfb9-28db-4f21-bd87-c84a36eab4db', '0c847a9c-69dd-437a-bdd4-c571cb8a7f8d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:36 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:06:36 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:36 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 34f1605f-4171-4b0d-86a0-ba4683594918: deleting Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 34f1605f-4171-4b0d-86a0-ba4683594918: deleting {{(pid=85889) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 17:06:36 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.627s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:36 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-464be287-5a4d-4218-9c08-dfd1f8b362d7 tempest-GroupSnapshotsTest-1295499239 None] Delete group completed successfully. Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-ba7c7dec-c715-4bcb-b05c-f4bd655d1df4" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-ba7c7dec-c715-4bcb-b05c-f4bd655d1df4" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Deleting offline snapshot ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 of volume 57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] snapshot_file for this snap is: volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f18b29b-85da-46ff-a024-9bcb3d9b30d5]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:37 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 Sep 17 17:06:37 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:37 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4" returned: 0 in 0.668s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:06:37 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[648611e0-0901-42e3-ad14-02cee48e8b20]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:37 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 Sep 17 17:06:37 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:38 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-de5aab95-b175-4e24-a572-5bf42ae0c14c tempest-ServerActionsTestOtherA-1009400035 None] Terminate volume connection completed successfully. Sep 17 17:06:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-de5aab95-b175-4e24-a572-5bf42ae0c14c tempest-ServerActionsTestOtherA-1009400035 None] Deleting attachment 0a150a6a-a305-45ac-a444-8b574157089b. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:06:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "cinder-de2902cd-4335-414c-8ca5-99a3b8490376-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Lock "cinder-de2902cd-4335-414c-8ca5-99a3b8490376-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "cinder-quobyte-de2902cd-4335-414c-8ca5-99a3b8490376" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Lock "cinder-quobyte-de2902cd-4335-414c-8ca5-99a3b8490376" acquired by "delete_volume" :: waited 0.051s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:38 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6ac90a-bc31-4509-8b47-a77df3b92d6b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:38 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" returned: 0 in 1.186s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:38 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 Sep 17 17:06:38 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:38 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 Sep 17 17:06:38 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:39 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376" returned: 0 in 0.825s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:39 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376 Sep 17 17:06:39 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:39 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "cinder-f690e451-d908-4aa9-bd59-ffbc3d02e1a7-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4" returned: 0 in 0.893s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Lock "cinder-f690e451-d908-4aa9-bd59-ffbc3d02e1a7-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:39 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4 Sep 17 17:06:39 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "cinder-quobyte-f690e451-d908-4aa9-bd59-ffbc3d02e1a7" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Lock "cinder-quobyte-f690e451-d908-4aa9-bd59-ffbc3d02e1a7" acquired by "delete_volume" :: waited 0.084s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:40 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff8f8c2-cef2-42b9-8c61-898eb7bf152f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-de2902cd-4335-414c-8ca5-99a3b8490376" returned: 0 in 0.603s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:40 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70.ba7c7dec-c715-4bcb-b05c-f4bd655d1df4" returned: 0 in 0.397s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Lock "cinder-quobyte-de2902cd-4335-414c-8ca5-99a3b8490376" released by "delete_volume" :: held 1.582s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-ba7c7dec-c715-4bcb-b05c-f4bd655d1df4" released by "_delete_snapshot" :: held 3.337s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" released by "delete_snapshot" :: held 3.406s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:40 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7 Sep 17 17:06:40 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG cinder.quota [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Created reservations ['c78f66e4-21c4-429e-9923-c4ca02561674', '325de1cd-e9e8-4d15-82bc-a69d32b21e94', '4cface63-6a9b-4648-a314-c2c80a5beef7', 'ed776222-fd26-48c6-8b2e-bccaf4969085'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:06:40 devstack cinder-volume[85889]: WARNING cinder.quota [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1183667887 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1183667887, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['adddf3e7-b2cf-4524-a8b4-a7d74b0457b4', 'a2bbf498-43bb-4e67-a10e-6d55d0a16d92', 'a1f59853-698a-4a59-8f13-7bc4f912c4ef', 'fa4595ec-9a92-4754-a8bc-f11da09796a6'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:06:40 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:06:40 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:40 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7" returned: 0 in 0.771s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:40 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7 Sep 17 17:06:40 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1f77c638-2a3f-4bd1-a8e3-48c0ad705994 tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 34f1605f-4171-4b0d-86a0-ba4683594918: deleted successfully Sep 17 17:06:41 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.519s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG cinder.manager [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:06:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Deleted volume successfully. Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-280ddf30-4f32-45f1-8dbf-ed7cfdd06363 req-8f37a316-2a7b-427a-ba73-55e99351a40d tempest-ServerActionsTestOtherA-1009400035 None] Lock "cinder-de2902cd-4335-414c-8ca5-99a3b8490376-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:41 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f690e451-d908-4aa9-bd59-ffbc3d02e1a7" returned: 0 in 0.547s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Lock "cinder-quobyte-f690e451-d908-4aa9-bd59-ffbc3d02e1a7" released by "delete_volume" :: held 1.410s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Created reservations ['9abe94c8-1d19-401e-8a69-1e2fedcf5c82', '98be9f1f-edb1-4d25-ab4f-718dc2ce6340', '8da46a01-c1d2-4917-9dc6-f6accdbc4169', '12cfa061-1a1f-4b7e-899d-38edc21f05e6'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:41 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:06:41 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:06:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" acquired by "delete_volume" :: waited 0.050s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:06:42 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.560s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:42 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:06:42 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Deleted volume successfully. Sep 17 17:06:42 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e356e769-8609-48e3-a07f-0c39d9065e38]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a595b78e-1b1f-4c92-a366-ec95516ddadf tempest-ServerActionsTestOtherA-1009400035 None] Lock "cinder-f690e451-d908-4aa9-bd59-ffbc3d02e1a7-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:42 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 Sep 17 17:06:42 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:42 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" returned: 0 in 0.694s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:43 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70 Sep 17 17:06:43 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:43 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" returned: 0 in 0.832s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-57dfe3ac-d4e7-4fb6-9c18-9c4796eb1e70" released by "delete_volume" :: held 1.750s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:06:44 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['3b9f33f3-0721-4831-a332-4559c37e34d0'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:06:44 devstack cinder-volume[85889]: WARNING cinder.db.api [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1183667887'] Sep 17 17:06:44 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['c557c20d-4e7f-42d8-b78a-13ae6411af5b', 'b37e2f99-d2f6-4299-b552-38bfd57a248d', '92ed59cd-664b-4c7a-8dca-dde437b9d316', '9461267c-12fb-4630-b34d-c0e4092f0532'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:06:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:44 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:06:44 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:45 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.773s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:45 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:06:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ea4c88d1-7bf7-4d2a-9a55-7571f5fc8958 tempest-GroupSnapshotsTest-1295499239 None] Delete group completed successfully. Sep 17 17:06:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ceaa2619-142c-4cd1-b496-cdf9f6064f55 tempest-GroupSnapshotsTest-1295499239 None] Group tempest-GroupSnapshotsTest-Group-540538028: creating Sep 17 17:06:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ceaa2619-142c-4cd1-b496-cdf9f6064f55 tempest-GroupSnapshotsTest-1295499239 None] Group tempest-GroupSnapshotsTest-Group-540538028: created successfully Sep 17 17:06:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ceaa2619-142c-4cd1-b496-cdf9f6064f55 tempest-GroupSnapshotsTest-1295499239 None] Create group completed successfully. Sep 17 17:06:47 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Flow 'volume_create_manager' (9d876cc1-1b01-4050-ab04-5c6367c92cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d6395e-4153-406b-8d32-8e657996a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d6395e-4153-406b-8d32-8e657996a342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-815040497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bed32c75-4a9b-44af-afb1-a6da0114d397,host='devstack@QuobyteHD#QuobyteHD',id=d58eac77-ca44-498a-a207-c04517be588e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e6affb477448cabf87c415e48166c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:06:48Z,use_quota=True,user_id='149d0d66ab2247baa15756aba759b9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3579707-4ada-4d12-817e-d55f6e34bbfc),volume_type_id=f3579707-4ada-4d12-817e-d55f6e34bbfc)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3791ecdb-1f9c-4422-bf3e-0a0ce443a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3791ecdb-1f9c-4422-bf3e-0a0ce443a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e754ef30-c0ab-4fe6-8a13-5bd3b8659b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e754ef30-c0ab-4fe6-8a13-5bd3b8659b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58eac77-ca44-498a-a207-c04517be588e', 'volume_name': 'volume-d58eac77-ca44-498a-a207-c04517be588e', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f73e27f-0cd0-4d09-9989-5d7ecc76e5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f73e27f-0cd0-4d09-9989-5d7ecc76e5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4fe7de-7c4f-4d58-8727-ecfa4d5e16d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:48 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Volume d58eac77-ca44-498a-a207-c04517be588e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58eac77-ca44-498a-a207-c04517be588e', 'volume_size': 1} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bed32c75-4a9b-44af-afb1-a6da0114d397,created_at=2026-09-17T15:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-815040497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bed32c75-4a9b-44af-afb1-a6da0114d397,host='devstack@QuobyteHD#QuobyteHD',id=d58eac77-ca44-498a-a207-c04517be588e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e6affb477448cabf87c415e48166c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:06:48Z,use_quota=True,user_id='149d0d66ab2247baa15756aba759b9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3579707-4ada-4d12-817e-d55f6e34bbfc),volume_type_id=f3579707-4ada-4d12-817e-d55f6e34bbfc)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Creating volume d58eac77-ca44-498a-a207-c04517be588e {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:06:48 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:48 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e 1073741824 Sep 17 17:06:48 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:48 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e 1073741824" returned: 0 in 0.787s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:49 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e Sep 17 17:06:49 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:49 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e" returned: 0 in 0.290s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:06:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4fe7de-7c4f-4d58-8727-ecfa4d5e16d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58eac77-ca44-498a-a207-c04517be588e', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7b44a7-e8ee-47ab-9831-b84f91c3bcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:49 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Volume volume-d58eac77-ca44-498a-a207-c04517be588e (d58eac77-ca44-498a-a207-c04517be588e): created successfully Sep 17 17:06:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7b44a7-e8ee-47ab-9831-b84f91c3bcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Flow 'volume_create_manager' (9d876cc1-1b01-4050-ab04-5c6367c92cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:06:49 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4e8b0c8e-8feb-494e-a508-3fff080f779b tempest-GroupSnapshotsTest-1295499239 None] Created volume successfully. Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Flow 'volume_create_manager' (1b419815-57ac-4cb8-8406-ac897315bcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408ed74e-7df8-4212-b11b-f95581438653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408ed74e-7df8-4212-b11b-f95581438653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1561277453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bed32c75-4a9b-44af-afb1-a6da0114d397,host='devstack@QuobyteHD#QuobyteHD',id=c7359406-38f3-4dc3-ae79-b063d2a960f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e6affb477448cabf87c415e48166c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:06:50Z,use_quota=True,user_id='149d0d66ab2247baa15756aba759b9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3579707-4ada-4d12-817e-d55f6e34bbfc),volume_type_id=f3579707-4ada-4d12-817e-d55f6e34bbfc)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1a3b10-92cb-405a-8cf8-ea3067cea576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1a3b10-92cb-405a-8cf8-ea3067cea576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2489d8-492c-468d-9d87-0f250c3b9e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2489d8-492c-468d-9d87-0f250c3b9e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7359406-38f3-4dc3-ae79-b063d2a960f0', 'volume_name': 'volume-c7359406-38f3-4dc3-ae79-b063d2a960f0', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c820192a-7ed3-4a44-a802-1b0ed2a9070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c820192a-7ed3-4a44-a802-1b0ed2a9070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69e0e14-9522-46ad-9790-dbf5d363d535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:50 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Volume c7359406-38f3-4dc3-ae79-b063d2a960f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7359406-38f3-4dc3-ae79-b063d2a960f0', 'volume_size': 1} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bed32c75-4a9b-44af-afb1-a6da0114d397,created_at=2026-09-17T15:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1561277453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bed32c75-4a9b-44af-afb1-a6da0114d397,host='devstack@QuobyteHD#QuobyteHD',id=c7359406-38f3-4dc3-ae79-b063d2a960f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e6affb477448cabf87c415e48166c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:06:50Z,use_quota=True,user_id='149d0d66ab2247baa15756aba759b9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3579707-4ada-4d12-817e-d55f6e34bbfc),volume_type_id=f3579707-4ada-4d12-817e-d55f6e34bbfc)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Creating volume c7359406-38f3-4dc3-ae79-b063d2a960f0 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:06:50 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:50 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 1073741824 Sep 17 17:06:50 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:50 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 1073741824" returned: 0 in 0.652s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:06:51 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 Sep 17 17:06:51 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:06:51 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Sep 17 17:06:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0" returned: 0 in 0.551s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:06:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:06:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:06:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69e0e14-9522-46ad-9790-dbf5d363d535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7359406-38f3-4dc3-ae79-b063d2a960f0', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1703f293-3695-4f76-b3fe-918ba825bbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:06:51 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Volume volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 (c7359406-38f3-4dc3-ae79-b063d2a960f0): created successfully Sep 17 17:06:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1703f293-3695-4f76-b3fe-918ba825bbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:06:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Flow 'volume_create_manager' (1b419815-57ac-4cb8-8406-ac897315bcea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:06:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f4967b46-bc42-43af-883c-5129abfdce95 tempest-GroupSnapshotsTest-1295499239 None] Created volume successfully. Sep 17 17:06:53 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-11e4bdda-a04c-4e68-b699-2c2aa7ed5a2a tempest-GroupSnapshotsTest-1295499239 None] Update group completed successfully. Sep 17 17:06:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-143d0a35-2cca-486f-ba47-215f19dd9575 tempest-GroupSnapshotsTest-1295499239 None] Update group completed successfully. Sep 17 17:06:55 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c2556bc2-17c4-45b1-9390-bd0fa84c972e tempest-GroupSnapshotsTest-1295499239 None] Update group completed successfully. Sep 17 17:06:57 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f9191ab4-9620-42d5-a16b-43e6d9dc8698 tempest-GroupSnapshotsTest-1295499239 None] Update group completed successfully. Sep 17 17:06:59 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] GroupSnapshot 8cd917d5-1284-41dc-bbd5-afb586348f9b: creating. Sep 17 17:06:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Group snapshot 8cd917d5-1284-41dc-bbd5-afb586348f9b: creating. {{(pid=85889) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 17:06:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:06:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:06:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Creating offline snapshot 00c5de46-1116-4fb6-8f3b-9be1fd38d09c of volume d58eac77-ca44-498a-a207-c04517be588e {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:06:59 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[81203886-33db-412e-915e-3fead734802b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:06:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:00 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e Sep 17 17:07:00 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:00 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e" returned: 0 in 0.705s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:00 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c 1G Sep 17 17:07:00 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:01 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c 1G" returned: 0 in 0.646s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58eac77-ca44-498a-a207-c04517be588e -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:01 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58eac77-ca44-498a-a207-c04517be588e -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c Sep 17 17:07:01 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:01 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58eac77-ca44-498a-a207-c04517be588e -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c" returned: 0 in 0.397s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:01 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:07:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:01 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c Sep 17 17:07:01 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:02 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c" returned: 0 in 0.376s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:02 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.info Sep 17 17:07:02 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:02 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.info" returned: 0 in 0.438s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:02 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:07:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:02 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.info Sep 17 17:07:02 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:02 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.info" returned: 0 in 0.423s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.227s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Creating offline snapshot 89918ca0-329b-479f-a495-470011323a55 of volume c7359406-38f3-4dc3-ae79-b063d2a960f0 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:07:03 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[216d4b25-9bd5-4fa4-9f8b-5cd0b876405f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:03 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 Sep 17 17:07:03 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:03 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0" returned: 0 in 0.450s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:03 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 1G Sep 17 17:07:03 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:04 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 1G" returned: 0 in 0.495s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:04 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 Sep 17 17:07:04 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:04 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55" returned: 0 in 0.312s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:04 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:07:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:04 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 Sep 17 17:07:04 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:04 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55" returned: 0 in 0.279s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:04 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.info Sep 17 17:07:04 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:04 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.info" returned: 0 in 0.365s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:05 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:05 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.info Sep 17 17:07:05 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:05 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.info" returned: 0 in 0.457s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.479s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Flow 'volume_create_manager' (52a52345-d18c-4895-a7d3-188b22ef13f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f46d42-9a8d-46cb-adff-82833f3eb8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f46d42-9a8d-46cb-adff-82833f3eb8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-504612790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4bb4be-4c66-4176-adef-6f78c6316b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c511b8b67a4c1a982c50ff22cf522b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:07:06Z,use_quota=True,user_id='2aeb0bdfe96541ab962b19c249649c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84dcb06-2f46-49ca-a4bd-238840f04fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84dcb06-2f46-49ca-a4bd-238840f04fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fd7e62-fc76-4302-8079-76d31ef74b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9fd7e62-fc76-4302-8079-76d31ef74b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a4bb4be-4c66-4176-adef-6f78c6316b18', 'volume_name': 'volume-8a4bb4be-4c66-4176-adef-6f78c6316b18', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9ce4db-aada-42ea-91c0-6de519be731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9ce4db-aada-42ea-91c0-6de519be731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a90658-37ac-42ec-a087-61d9c7f54aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:05 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Volume 8a4bb4be-4c66-4176-adef-6f78c6316b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a4bb4be-4c66-4176-adef-6f78c6316b18', 'volume_size': 1} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-504612790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4bb4be-4c66-4176-adef-6f78c6316b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c511b8b67a4c1a982c50ff22cf522b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:07:06Z,use_quota=True,user_id='2aeb0bdfe96541ab962b19c249649c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Creating volume 8a4bb4be-4c66-4176-adef-6f78c6316b18 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:07:05 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:07:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:05 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18 1073741824 Sep 17 17:07:05 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:05 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-11b876e2-5aaf-4dbf-8225-20764973bb26 tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 8cd917d5-1284-41dc-bbd5-afb586348f9b: created successfully Sep 17 17:07:06 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18 1073741824" returned: 0 in 0.642s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:06 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 8cd917d5-1284-41dc-bbd5-afb586348f9b: deleting Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 8cd917d5-1284-41dc-bbd5-afb586348f9b: deleting {{(pid=85889) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 17:07:06 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18 Sep 17 17:07:06 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-d58eac77-ca44-498a-a207-c04517be588e" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-d58eac77-ca44-498a-a207-c04517be588e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-00c5de46-1116-4fb6-8f3b-9be1fd38d09c" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-00c5de46-1116-4fb6-8f3b-9be1fd38d09c" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Deleting offline snapshot 00c5de46-1116-4fb6-8f3b-9be1fd38d09c of volume d58eac77-ca44-498a-a207-c04517be588e {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] snapshot_file for this snap is: volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e1b919-f682-42f0-aec6-59a45c7c875a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:06 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18" returned: 0 in 0.320s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a90658-37ac-42ec-a087-61d9c7f54aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a4bb4be-4c66-4176-adef-6f78c6316b18', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b4af12-6d3d-45c8-89f0-881a6e1433e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:06 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Volume volume-8a4bb4be-4c66-4176-adef-6f78c6316b18 (8a4bb4be-4c66-4176-adef-6f78c6316b18): created successfully Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b4af12-6d3d-45c8-89f0-881a6e1433e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Flow 'volume_create_manager' (52a52345-d18c-4895-a7d3-188b22ef13f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:07:06 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5dbd98a3-1039-4fb2-99f4-f0a74610d422 tempest-ServersNegativeTestJSON-1059219997 None] Created volume successfully. Sep 17 17:07:06 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c Sep 17 17:07:06 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:07 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c" returned: 0 in 0.556s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d58eac77-ca44-498a-a207-c04517be588e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:07:07 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9566b4-a07d-406d-a5cd-72144633535a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:07 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e Sep 17 17:07:07 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:07 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e" returned: 0 in 0.391s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:07 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c Sep 17 17:07:07 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:08 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c" returned: 0 in 0.525s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:08 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c Sep 17 17:07:08 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:08 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e.00c5de46-1116-4fb6-8f3b-9be1fd38d09c" returned: 0 in 0.325s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-00c5de46-1116-4fb6-8f3b-9be1fd38d09c" released by "_delete_snapshot" :: held 1.965s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-d58eac77-ca44-498a-a207-c04517be588e" released by "delete_snapshot" :: held 2.010s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-c7359406-38f3-4dc3-ae79-b063d2a960f0" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-c7359406-38f3-4dc3-ae79-b063d2a960f0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-89918ca0-329b-479f-a495-470011323a55" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-89918ca0-329b-479f-a495-470011323a55" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Deleting offline snapshot 89918ca0-329b-479f-a495-470011323a55 of volume c7359406-38f3-4dc3-ae79-b063d2a960f0 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] snapshot_file for this snap is: volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4995ae0-1f36-4a32-bedb-fce9046581e6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:08 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 Sep 17 17:07:08 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:09 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55" returned: 0 in 0.466s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7359406-38f3-4dc3-ae79-b063d2a960f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:07:09 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[208cdc84-bd4f-48b4-b23a-eb9b46e4bf42]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:09 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 Sep 17 17:07:09 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:09 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0" returned: 0 in 0.408s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:09 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 Sep 17 17:07:09 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:09 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55" returned: 0 in 0.354s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:09 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55 Sep 17 17:07:09 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:10 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0.89918ca0-329b-479f-a495-470011323a55" returned: 0 in 0.272s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-89918ca0-329b-479f-a495-470011323a55" released by "_delete_snapshot" :: held 1.634s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-c7359406-38f3-4dc3-ae79-b063d2a960f0" released by "delete_snapshot" :: held 1.657s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:10 devstack cinder-volume[85889]: WARNING cinder.quota [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1215398266 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1215398266, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:07:10 devstack cinder-volume[85889]: WARNING cinder.quota [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1215398266 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1215398266, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:07:10 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['03194708-db7f-4518-886d-3909fa287fd0', '44a78d06-ac2b-4319-bc5c-4577f00dcdfd', '38aca59d-d374-41b5-a1d0-6f8bad7c6819', 'e572a10c-3972-4255-9e27-9c7a0b1e59e7'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:10 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['d4cc088b-dc37-4936-8c1a-5a588eb6e6f6', 'b23c808d-69c8-435d-87bc-4d8d9d25b73a', 'f8453940-617a-4e9a-a6fa-93855afd2921', 'c993eceb-9cd8-4c02-a368-82fd432c4c6d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a0e138e5-2779-418d-b32f-d780aeb1736c tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 8cd917d5-1284-41dc-bbd5-afb586348f9b: deleted successfully Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-c7359406-38f3-4dc3-ae79-b063d2a960f0" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-c7359406-38f3-4dc3-ae79-b063d2a960f0" acquired by "delete_volume" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[85615fac-aa24-4757-9aa1-50a381cb97b6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Flow 'volume_create_manager' (b7e95762-8e40-49ca-8f57-ad380bfb1f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f10843-333f-4a53-856c-1ca89552ebf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f10843-333f-4a53-856c-1ca89552ebf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1615130779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c9b370-4127-4ac1-b62b-caf5aea6d4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c511b8b67a4c1a982c50ff22cf522b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:07:12Z,use_quota=True,user_id='2aeb0bdfe96541ab962b19c249649c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608aaf3d-d018-4550-bb1e-8bce33aeabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608aaf3d-d018-4550-bb1e-8bce33aeabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84e7401-60e1-41d1-949e-4d6f85eb945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84e7401-60e1-41d1-949e-4d6f85eb945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c9b370-4127-4ac1-b62b-caf5aea6d4be', 'volume_name': 'volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83191e31-8e65-49bb-9a32-d35c69a2560c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83191e31-8e65-49bb-9a32-d35c69a2560c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b05621-62fd-4cef-9dfd-00b562ce48bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:11 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 Sep 17 17:07:11 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Volume d8c9b370-4127-4ac1-b62b-caf5aea6d4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be', 'volume_size': 1} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:11 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1615130779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c9b370-4127-4ac1-b62b-caf5aea6d4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c511b8b67a4c1a982c50ff22cf522b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:07:12Z,use_quota=True,user_id='2aeb0bdfe96541ab962b19c249649c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Creating volume d8c9b370-4127-4ac1-b62b-caf5aea6d4be {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:07:11 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:07:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:11 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be 1073741824 Sep 17 17:07:11 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:12 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0" returned: 0 in 0.588s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:12 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0 Sep 17 17:07:12 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:12 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c7359406-38f3-4dc3-ae79-b063d2a960f0" returned: 0 in 0.346s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:12 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be 1073741824" returned: 0 in 0.779s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-c7359406-38f3-4dc3-ae79-b063d2a960f0" released by "delete_volume" :: held 1.050s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-d58eac77-ca44-498a-a207-c04517be588e" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-d58eac77-ca44-498a-a207-c04517be588e" acquired by "delete_volume" :: waited 0.042s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:12 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7422d5-0a9f-4004-baba-1ef21996ac17]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:12 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be Sep 17 17:07:12 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:13 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e Sep 17 17:07:13 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:13 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be" returned: 0 in 0.445s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:07:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b05621-62fd-4cef-9dfd-00b562ce48bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3123451-d530-4c41-a905-57e03248246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:13 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Volume volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be (d8c9b370-4127-4ac1-b62b-caf5aea6d4be): created successfully Sep 17 17:07:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3123451-d530-4c41-a905-57e03248246e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Flow 'volume_create_manager' (b7e95762-8e40-49ca-8f57-ad380bfb1f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:07:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a371b878-bd02-4e92-83ee-d8931ebed0bc tempest-ServersNegativeTestJSON-1059219997 None] Created volume successfully. Sep 17 17:07:13 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e" returned: 0 in 0.658s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:13 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e Sep 17 17:07:13 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:13 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d58eac77-ca44-498a-a207-c04517be588e" returned: 0 in 0.491s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-d58eac77-ca44-498a-a207-c04517be588e" released by "delete_volume" :: held 1.254s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['0512bb17-ce5a-4869-91f1-2c6a067e0344'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:14 devstack cinder-volume[85889]: WARNING cinder.quota [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1215398266 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1215398266, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['4838f4fc-c81a-46ef-855a-8fcbd1dfe6c5', '91616bc5-f117-4d29-8237-836d96ffd36c', 'd60b2437-226c-42a5-8584-90d8f32139fe', '2bdf0fcf-7eff-4ad5-8914-1976e348c6d8'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['c026e6ad-f60d-4ea3-af85-cfe7fbc40b32', '8bb68fff-63ef-4f18-bee5-747e3fc5f555', '29e2fa25-7eb4-44ad-8e7d-9562d62193ed', '12a3b182-8ebb-4187-84b3-bc083ab2f683'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:14 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:07:14 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:14 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.387s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:14 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:07:15 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4b3e686c-0bb7-4240-a751-1aa04384506b tempest-GroupSnapshotsTest-1295499239 None] Delete group completed successfully. Sep 17 17:07:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Acquiring lock "cinder-d8c9b370-4127-4ac1-b62b-caf5aea6d4be-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Lock "cinder-d8c9b370-4127-4ac1-b62b-caf5aea6d4be-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Acquiring lock "cinder-quobyte-d8c9b370-4127-4ac1-b62b-caf5aea6d4be" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Lock "cinder-quobyte-d8c9b370-4127-4ac1-b62b-caf5aea6d4be" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d029eb4d-4e88-412d-b733-fece01cd2846]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:15 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be Sep 17 17:07:15 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:15 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be" returned: 0 in 0.634s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:15 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be Sep 17 17:07:15 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ad911cc9-ac65-4aab-b2f3-434cd454d550 tempest-GroupSnapshotsTest-1295499239 None] Group tempest-GroupSnapshotsTest-Group-1477601721: creating Sep 17 17:07:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ad911cc9-ac65-4aab-b2f3-434cd454d550 tempest-GroupSnapshotsTest-1295499239 None] Group tempest-GroupSnapshotsTest-Group-1477601721: created successfully Sep 17 17:07:16 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ad911cc9-ac65-4aab-b2f3-434cd454d550 tempest-GroupSnapshotsTest-1295499239 None] Create group completed successfully. Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8c9b370-4127-4ac1-b62b-caf5aea6d4be" returned: 0 in 0.454s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Lock "cinder-quobyte-d8c9b370-4127-4ac1-b62b-caf5aea6d4be" released by "delete_volume" :: held 1.177s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Created reservations ['446de5d9-e484-49b2-ba0e-b5cd552a800d', '0a262469-9216-4f2d-92f8-2e5fe6e14a39', 'f0c32820-c192-440b-a295-abcc62136bd3', '7079a5ba-9f60-453c-821e-f658c8b917c3'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:16 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:07:16 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:16 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:07:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Deleted volume successfully. Sep 17 17:07:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b83e754b-8b63-4388-9818-599f14a3ad53 tempest-ServersNegativeTestJSON-1059219997 None] Lock "cinder-d8c9b370-4127-4ac1-b62b-caf5aea6d4be-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Acquiring lock "cinder-8a4bb4be-4c66-4176-adef-6f78c6316b18-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Lock "cinder-8a4bb4be-4c66-4176-adef-6f78c6316b18-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Acquiring lock "cinder-quobyte-8a4bb4be-4c66-4176-adef-6f78c6316b18" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Lock "cinder-quobyte-8a4bb4be-4c66-4176-adef-6f78c6316b18" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:17 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1a5d4e-009d-4aca-a6d2-d6957016ce5e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:17 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18 Sep 17 17:07:17 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:18 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18" returned: 0 in 0.606s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:07:18 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18 Sep 17 17:07:18 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Flow 'volume_create_manager' (43fa6314-48cc-495d-8d01-322c48179120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a7b1f7-7789-47ee-aa1c-51cccdaa60bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a7b1f7-7789-47ee-aa1c-51cccdaa60bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-564569049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f66d1bd-1e95-4744-a4a6-21fd29a9c1f6,host='devstack@QuobyteHD#QuobyteHD',id=34c850d5-89d1-4ed6-965e-07cf30d27416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e6affb477448cabf87c415e48166c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:07:18Z,use_quota=True,user_id='149d0d66ab2247baa15756aba759b9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d16550e5-cc1d-4ebe-950f-9b4b332c3b3c),volume_type_id=d16550e5-cc1d-4ebe-950f-9b4b332c3b3c)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13c3ac5-506a-49c1-b9e4-5743b0d88fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13c3ac5-506a-49c1-b9e4-5743b0d88fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28dab4e-3b93-4b7e-b559-cf76256d8a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28dab4e-3b93-4b7e-b559-cf76256d8a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c850d5-89d1-4ed6-965e-07cf30d27416', 'volume_name': 'volume-34c850d5-89d1-4ed6-965e-07cf30d27416', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73976007-e9dd-4fdb-b3e7-31b9d7ffdc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73976007-e9dd-4fdb-b3e7-31b9d7ffdc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7200eb1-0167-4875-b29d-94bc1cc6483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:18 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Volume 34c850d5-89d1-4ed6-965e-07cf30d27416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c850d5-89d1-4ed6-965e-07cf30d27416', 'volume_size': 1} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f66d1bd-1e95-4744-a4a6-21fd29a9c1f6,created_at=2026-09-17T15:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-564569049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f66d1bd-1e95-4744-a4a6-21fd29a9c1f6,host='devstack@QuobyteHD#QuobyteHD',id=34c850d5-89d1-4ed6-965e-07cf30d27416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e6affb477448cabf87c415e48166c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:07:18Z,use_quota=True,user_id='149d0d66ab2247baa15756aba759b9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d16550e5-cc1d-4ebe-950f-9b4b332c3b3c),volume_type_id=d16550e5-cc1d-4ebe-950f-9b4b332c3b3c)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Creating volume 34c850d5-89d1-4ed6-965e-07cf30d27416 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:07:18 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:18 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 1073741824 Sep 17 17:07:18 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:18 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a4bb4be-4c66-4176-adef-6f78c6316b18" returned: 0 in 0.283s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Lock "cinder-quobyte-8a4bb4be-4c66-4176-adef-6f78c6316b18" released by "delete_volume" :: held 0.963s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Created reservations ['552d5931-3677-40dd-ad44-1dc672421289', 'e04faa72-8621-4431-b038-376bd568fa2f', 'e2f62db9-44ee-4ef3-8d4a-ba6aa352bbc4', 'c16cb88a-4592-44ed-b10c-d8a0453b11d9'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:18 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:07:18 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:19 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 1073741824" returned: 0 in 0.875s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:19 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.594s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:07:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Deleted volume successfully. Sep 17 17:07:19 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 Sep 17 17:07:19 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7a739e93-b880-4ff0-8756-6188421c0b56 tempest-ServersNegativeTestJSON-1059219997 None] Lock "cinder-8a4bb4be-4c66-4176-adef-6f78c6316b18-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:19 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416" returned: 0 in 0.477s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7200eb1-0167-4875-b29d-94bc1cc6483e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c850d5-89d1-4ed6-965e-07cf30d27416', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cde0ede-45b2-4979-805a-2c88d6892936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:19 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Volume volume-34c850d5-89d1-4ed6-965e-07cf30d27416 (34c850d5-89d1-4ed6-965e-07cf30d27416): created successfully Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cde0ede-45b2-4979-805a-2c88d6892936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Flow 'volume_create_manager' (43fa6314-48cc-495d-8d01-322c48179120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:07:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-923be338-288e-40a7-b33e-d1f3da9cb6db tempest-GroupSnapshotsTest-1295499239 None] Created volume successfully. Sep 17 17:07:21 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] GroupSnapshot 828f2657-99f1-4ca8-9247-a0ad427e0a87: creating. Sep 17 17:07:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Group snapshot 828f2657-99f1-4ca8-9247-a0ad427e0a87: creating. {{(pid=85889) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 17:07:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Creating offline snapshot 0ea144fc-9a76-4177-bac8-be8ae81cee7e of volume 34c850d5-89d1-4ed6-965e-07cf30d27416 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:07:21 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[969d25ae-09f2-417d-8ec7-e8d1ac73bf5c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:21 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 Sep 17 17:07:21 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:22 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416" returned: 0 in 0.600s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:22 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e 1G Sep 17 17:07:22 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:22 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:07:22 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:22 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.448s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:07:22 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e 1G" returned: 0 in 0.669s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c850d5-89d1-4ed6-965e-07cf30d27416 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:22 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c850d5-89d1-4ed6-965e-07cf30d27416 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e Sep 17 17:07:22 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:23 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c850d5-89d1-4ed6-965e-07cf30d27416 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e" returned: 0 in 0.411s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:23 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:07:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:23 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e Sep 17 17:07:23 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:23 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e" returned: 0 in 0.340s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:23 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.info Sep 17 17:07:23 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:24 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.info" returned: 0 in 0.578s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:24 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:07:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:24 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.info Sep 17 17:07:24 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:24 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.info" returned: 0 in 0.349s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.105s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:24 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b92a7e22-5f1b-4577-8fda-e2b6312b27b1 tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 828f2657-99f1-4ca8-9247-a0ad427e0a87: created successfully Sep 17 17:07:25 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 828f2657-99f1-4ca8-9247-a0ad427e0a87: deleting Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 828f2657-99f1-4ca8-9247-a0ad427e0a87: deleting {{(pid=85889) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-34c850d5-89d1-4ed6-965e-07cf30d27416" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-34c850d5-89d1-4ed6-965e-07cf30d27416" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-0ea144fc-9a76-4177-bac8-be8ae81cee7e" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-0ea144fc-9a76-4177-bac8-be8ae81cee7e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Deleting offline snapshot 0ea144fc-9a76-4177-bac8-be8ae81cee7e of volume 34c850d5-89d1-4ed6-965e-07cf30d27416 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] snapshot_file for this snap is: volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac322a0-dccf-450b-8dcd-c5985fcb1703]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:25 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e Sep 17 17:07:25 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:25 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e" returned: 0 in 0.466s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34c850d5-89d1-4ed6-965e-07cf30d27416(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:07:25 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed59b67-fad9-4666-a68a-4cd809012793]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:26 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 Sep 17 17:07:26 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:26 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416" returned: 0 in 0.637s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:26 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e Sep 17 17:07:26 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:27 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e" returned: 0 in 0.478s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:27 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e Sep 17 17:07:27 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:27 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416.0ea144fc-9a76-4177-bac8-be8ae81cee7e" returned: 0 in 0.282s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:27 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-0ea144fc-9a76-4177-bac8-be8ae81cee7e" released by "_delete_snapshot" :: held 2.031s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:27 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-34c850d5-89d1-4ed6-965e-07cf30d27416" released by "delete_snapshot" :: held 2.071s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:27 devstack cinder-volume[85889]: WARNING cinder.quota [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-439559099 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-439559099, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:07:27 devstack cinder-volume[85889]: WARNING cinder.quota [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-439559099 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-439559099, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:07:27 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['ece1182b-867e-4810-93cc-4575cadeb154', '20dc7ae1-a824-40b2-9482-d42b9bd4a371', '4e664460-1e6c-4355-a68c-395799f4979e', '1c6c59c2-3b04-429d-8cf4-3f2031b4d6dd'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:27 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ffe89588-0517-4418-99ca-83ff6f284575 tempest-GroupSnapshotsTest-1295499239 None] group_snapshot 828f2657-99f1-4ca8-9247-a0ad427e0a87: deleted successfully Sep 17 17:07:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "cinder-quobyte-34c850d5-89d1-4ed6-965e-07cf30d27416" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-34c850d5-89d1-4ed6-965e-07cf30d27416" acquired by "delete_volume" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:29 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[689e5949-9381-40ed-8046-ecaa307d8028]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:29 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 Sep 17 17:07:29 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:30 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416" returned: 0 in 0.878s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:30 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416 Sep 17 17:07:30 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Flow 'volume_create_manager' (affc4e2e-9b93-4e2a-a012-c56328cbd3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde3858e-1dbe-4b69-96b4-742031a157ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde3858e-1dbe-4b69-96b4-742031a157ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-156970626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36868042-e8df-49d1-b2f0-9de2ad648e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819139cd77f34d34aa2c4bdd813683d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:07:30Z,use_quota=True,user_id='b8391b965116406fa11ad98fda00f38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e266ecf4-a25b-4fca-9dee-2d43c55cf4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e266ecf4-a25b-4fca-9dee-2d43c55cf4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a566e899-d107-4a9c-966d-915470daef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a566e899-d107-4a9c-966d-915470daef53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36868042-e8df-49d1-b2f0-9de2ad648e01', 'volume_name': 'volume-36868042-e8df-49d1-b2f0-9de2ad648e01', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fc5a4f-619f-476e-a9c3-3efb072e12fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13fc5a4f-619f-476e-a9c3-3efb072e12fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f036532-7ace-4619-86c3-7b39d8597aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Volume 36868042-e8df-49d1-b2f0-9de2ad648e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36868042-e8df-49d1-b2f0-9de2ad648e01', 'volume_size': 1} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-156970626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36868042-e8df-49d1-b2f0-9de2ad648e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819139cd77f34d34aa2c4bdd813683d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:07:30Z,use_quota=True,user_id='b8391b965116406fa11ad98fda00f38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Creating volume 36868042-e8df-49d1-b2f0-9de2ad648e01 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:07:30 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:07:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:30 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01 1073741824 Sep 17 17:07:30 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:31 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-34c850d5-89d1-4ed6-965e-07cf30d27416" returned: 0 in 0.494s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Lock "cinder-quobyte-34c850d5-89d1-4ed6-965e-07cf30d27416" released by "delete_volume" :: held 1.521s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['a5bd702f-bef7-4f86-aaf9-c1cc1ac784e2'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:31 devstack cinder-volume[85889]: WARNING cinder.quota [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-439559099 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-439559099, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Created reservations ['c4b60f01-4eb3-46c2-8f4a-f1e3beacffc5', 'e81dc03a-306e-4583-963d-db79b83b1d24', 'db0bd70b-c5ab-44e0-a975-3b4fb3d40398', '706d7a93-3cec-4d9c-bc8e-f0320381aa81'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:31 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:07:31 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:31 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.336s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:07:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-178df044-b8f6-4283-9e47-9cb36cf6eda1 tempest-GroupSnapshotsTest-1295499239 None] Delete group completed successfully. Sep 17 17:07:31 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01 1073741824" returned: 0 in 1.056s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:32 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01 Sep 17 17:07:32 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:32 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01" returned: 0 in 0.415s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:07:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f036532-7ace-4619-86c3-7b39d8597aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36868042-e8df-49d1-b2f0-9de2ad648e01', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fdc65f-504e-44ce-92a5-497ffe735c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:32 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Volume volume-36868042-e8df-49d1-b2f0-9de2ad648e01 (36868042-e8df-49d1-b2f0-9de2ad648e01): created successfully Sep 17 17:07:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fdc65f-504e-44ce-92a5-497ffe735c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Flow 'volume_create_manager' (affc4e2e-9b93-4e2a-a012-c56328cbd3a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:07:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5798e2ed-d445-49cc-a4e3-48ba5a9162a7 tempest-TestMinimumBasicScenario-1546616019 None] Created volume successfully. Sep 17 17:07:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-22bc6523-91b4-4f83-86c7-ed6642cd2846 req-80896e38-0785-4fdb-acc7-98144821f0b1 tempest-TestMinimumBasicScenario-1546616019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-22bc6523-91b4-4f83-86c7-ed6642cd2846 req-80896e38-0785-4fdb-acc7-98144821f0b1 tempest-TestMinimumBasicScenario-1546616019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-22bc6523-91b4-4f83-86c7-ed6642cd2846 req-80896e38-0785-4fdb-acc7-98144821f0b1 tempest-TestMinimumBasicScenario-1546616019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-22bc6523-91b4-4f83-86c7-ed6642cd2846 req-80896e38-0785-4fdb-acc7-98144821f0b1 tempest-TestMinimumBasicScenario-1546616019 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-36868042-e8df-49d1-b2f0-9de2ad648e01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0a90d80-22fd-4ffc-aed2-c2e5c1530ced', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:07:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-22bc6523-91b4-4f83-86c7-ed6642cd2846 req-80896e38-0785-4fdb-acc7-98144821f0b1 tempest-TestMinimumBasicScenario-1546616019 None] attachment_update completed successfully. Sep 17 17:07:44 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=131,cinder:SELECT=139,cinder:INSERT=30,cinder:DELETE=5 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:07:44 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=116,cinder:INSERT=35,cinder:UPDATE=144,cinder:DELETE=5 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:07:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6961b378-b4c5-41b8-bf95-b75746de49d6 tempest-GroupSnapshotsV319Test-1810067822 None] Group tempest-GroupSnapshotsV319Test-Group-100478625: creating Sep 17 17:07:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6961b378-b4c5-41b8-bf95-b75746de49d6 tempest-GroupSnapshotsV319Test-1810067822 None] Group tempest-GroupSnapshotsV319Test-Group-100478625: created successfully Sep 17 17:07:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6961b378-b4c5-41b8-bf95-b75746de49d6 tempest-GroupSnapshotsV319Test-1810067822 None] Create group completed successfully. Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Flow 'volume_create_manager' (7bf64a4d-3646-4dd9-921e-8d99dcda034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ea1c0e-51ae-4850-9615-6e99aab34f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ea1c0e-51ae-4850-9615-6e99aab34f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1857092383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09f20251-dc96-4f45-ada0-f87a87e237d0,host='devstack@QuobyteHD#QuobyteHD',id=eda46c30-80f9-468d-82e2-412b4008407b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8380005c1ac6434390b2c3239bc6ba7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:07:48Z,use_quota=True,user_id='3d2f5b04d6ce46239cf2e3b4361bf24b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a4e4df-3aa5-4418-91ea-d5164a93e225),volume_type_id=45a4e4df-3aa5-4418-91ea-d5164a93e225)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d509d491-afff-4e39-81a5-dc176e7edacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d509d491-afff-4e39-81a5-dc176e7edacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf5c9a0-8966-4680-bc48-4f58981feb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf5c9a0-8966-4680-bc48-4f58981feb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda46c30-80f9-468d-82e2-412b4008407b', 'volume_name': 'volume-eda46c30-80f9-468d-82e2-412b4008407b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5f2020-92a2-4842-b915-9df1a7cc37ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5f2020-92a2-4842-b915-9df1a7cc37ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c5ce8f-763b-44a1-aa75-cb7bf9514182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:48 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Volume eda46c30-80f9-468d-82e2-412b4008407b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda46c30-80f9-468d-82e2-412b4008407b', 'volume_size': 1} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=09f20251-dc96-4f45-ada0-f87a87e237d0,created_at=2026-09-17T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1857092383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09f20251-dc96-4f45-ada0-f87a87e237d0,host='devstack@QuobyteHD#QuobyteHD',id=eda46c30-80f9-468d-82e2-412b4008407b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8380005c1ac6434390b2c3239bc6ba7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:07:48Z,use_quota=True,user_id='3d2f5b04d6ce46239cf2e3b4361bf24b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a4e4df-3aa5-4418-91ea-d5164a93e225),volume_type_id=45a4e4df-3aa5-4418-91ea-d5164a93e225)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Creating volume eda46c30-80f9-468d-82e2-412b4008407b {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:07:48 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:48 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b 1073741824 Sep 17 17:07:48 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:48 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b 1073741824" returned: 0 in 0.676s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:49 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b Sep 17 17:07:49 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:49 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b" returned: 0 in 0.418s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:07:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c5ce8f-763b-44a1-aa75-cb7bf9514182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda46c30-80f9-468d-82e2-412b4008407b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36fc087-c585-4f24-8bbc-8abd3c9421ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:07:49 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Volume volume-eda46c30-80f9-468d-82e2-412b4008407b (eda46c30-80f9-468d-82e2-412b4008407b): created successfully Sep 17 17:07:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36fc087-c585-4f24-8bbc-8abd3c9421ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:07:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Flow 'volume_create_manager' (7bf64a4d-3646-4dd9-921e-8d99dcda034e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:07:49 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3fe2cded-c4fa-45fd-ba0f-ffafeecf9bcc tempest-GroupSnapshotsV319Test-1810067822 None] Created volume successfully. Sep 17 17:07:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] GroupSnapshot ac838b52-db67-4e67-b0d7-9b45af7c066b: creating. Sep 17 17:07:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Group snapshot ac838b52-db67-4e67-b0d7-9b45af7c066b: creating. {{(pid=85889) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 17:07:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Creating offline snapshot baa579b8-6121-4bbe-850f-2b9a735578f9 of volume eda46c30-80f9-468d-82e2-412b4008407b {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:07:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e265c3c4-8e03-4b0e-a44e-ee215391eb94]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-73f83464-f430-4842-901c-f6c7b6ffdad7 tempest-GroupsV320Test-92950457 None] Group tempest-GroupsV320Test-Group-1917979748: creating Sep 17 17:07:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-73f83464-f430-4842-901c-f6c7b6ffdad7 tempest-GroupsV320Test-92950457 None] Group tempest-GroupsV320Test-Group-1917979748: created successfully Sep 17 17:07:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-73f83464-f430-4842-901c-f6c7b6ffdad7 tempest-GroupsV320Test-92950457 None] Create group completed successfully. Sep 17 17:07:51 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b Sep 17 17:07:51 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:51 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b" returned: 0 in 0.429s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:51 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 1G Sep 17 17:07:51 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:52 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 1G" returned: 0 in 0.769s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda46c30-80f9-468d-82e2-412b4008407b -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:52 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda46c30-80f9-468d-82e2-412b4008407b -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 Sep 17 17:07:52 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:52 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda46c30-80f9-468d-82e2-412b4008407b -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9" returned: 0 in 0.414s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:52 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:07:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:52 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 Sep 17 17:07:52 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:52 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-2a91ae0e-3408-4426-bc98-4e3d2e447902 tempest-GroupsV320Test-92950457 None] Created reservations ['99811b42-919f-40c8-b624-a320f515139f'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2a91ae0e-3408-4426-bc98-4e3d2e447902 tempest-GroupsV320Test-92950457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2a91ae0e-3408-4426-bc98-4e3d2e447902 tempest-GroupsV320Test-92950457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2a91ae0e-3408-4426-bc98-4e3d2e447902 tempest-GroupsV320Test-92950457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2a91ae0e-3408-4426-bc98-4e3d2e447902 tempest-GroupsV320Test-92950457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2a91ae0e-3408-4426-bc98-4e3d2e447902 tempest-GroupsV320Test-92950457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2a91ae0e-3408-4426-bc98-4e3d2e447902 tempest-GroupsV320Test-92950457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:53 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:07:53 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:53 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9" returned: 0 in 0.352s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:53 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.info Sep 17 17:07:53 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:53 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2a91ae0e-3408-4426-bc98-4e3d2e447902 tempest-GroupsV320Test-92950457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.268s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-2a91ae0e-3408-4426-bc98-4e3d2e447902 tempest-GroupsV320Test-92950457 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:07:53 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-2a91ae0e-3408-4426-bc98-4e3d2e447902 tempest-GroupsV320Test-92950457 None] Delete group completed successfully. Sep 17 17:07:53 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.info" returned: 0 in 0.275s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:53 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:53 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.info Sep 17 17:07:53 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:53 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.info" returned: 0 in 0.232s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.587s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:53 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-098f8655-16fa-487c-83c3-80fe4b6cbec3 tempest-GroupSnapshotsV319Test-1810067822 None] group_snapshot ac838b52-db67-4e67-b0d7-9b45af7c066b: created successfully Sep 17 17:07:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] group_snapshot ac838b52-db67-4e67-b0d7-9b45af7c066b: deleting Sep 17 17:07:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] group_snapshot ac838b52-db67-4e67-b0d7-9b45af7c066b: deleting {{(pid=85889) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 17:07:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Acquiring lock "cinder-quobyte-eda46c30-80f9-468d-82e2-412b4008407b" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Lock "cinder-quobyte-eda46c30-80f9-468d-82e2-412b4008407b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Acquiring lock "cinder-quobyte-baa579b8-6121-4bbe-850f-2b9a735578f9" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Lock "cinder-quobyte-baa579b8-6121-4bbe-850f-2b9a735578f9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Deleting offline snapshot baa579b8-6121-4bbe-850f-2b9a735578f9 of volume eda46c30-80f9-468d-82e2-412b4008407b {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:07:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] snapshot_file for this snap is: volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:07:54 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[51192929-70e3-4771-8ddf-99731e5ca0d0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:55 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 Sep 17 17:07:55 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:55 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9" returned: 0 in 0.455s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eda46c30-80f9-468d-82e2-412b4008407b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:07:55 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9770145-6113-4445-a087-6510fadde8e0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:55 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b Sep 17 17:07:55 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:55 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b" returned: 0 in 0.380s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:55 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 Sep 17 17:07:55 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:56 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9" returned: 0 in 0.383s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:56 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9 Sep 17 17:07:56 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:56 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b.baa579b8-6121-4bbe-850f-2b9a735578f9" returned: 0 in 0.310s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Lock "cinder-quobyte-baa579b8-6121-4bbe-850f-2b9a735578f9" released by "_delete_snapshot" :: held 1.667s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Lock "cinder-quobyte-eda46c30-80f9-468d-82e2-412b4008407b" released by "delete_snapshot" :: held 1.694s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:56 devstack cinder-volume[85889]: WARNING cinder.quota [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-711018299 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-711018299, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:07:56 devstack cinder-volume[85889]: WARNING cinder.quota [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-711018299 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-711018299, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:07:56 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] Created reservations ['1bb2c963-601e-4b44-abb4-54038edcb638', '3517405f-708d-43b1-8d7c-56e665a45913', '4b39c948-03cb-4ea5-ab86-3dd8eb0d3826', 'bb447f93-aa43-4cc7-af57-2736c6bdd788'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7e0f14d4-4968-4f11-abde-dfb2bfe9b0bf tempest-GroupSnapshotsV319Test-1810067822 None] group_snapshot ac838b52-db67-4e67-b0d7-9b45af7c066b: deleted successfully Sep 17 17:07:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Acquiring lock "cinder-quobyte-eda46c30-80f9-468d-82e2-412b4008407b" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:07:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Lock "cinder-quobyte-eda46c30-80f9-468d-82e2-412b4008407b" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:07:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7300e4-1b50-4f2c-a3f1-c22641334318]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:07:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:58 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b Sep 17 17:07:58 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:58 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b" returned: 0 in 0.641s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:58 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b Sep 17 17:07:58 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:58 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eda46c30-80f9-468d-82e2-412b4008407b" returned: 0 in 0.306s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:58 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Lock "cinder-quobyte-eda46c30-80f9-468d-82e2-412b4008407b" released by "delete_volume" :: held 1.041s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:07:58 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Created reservations ['fb027879-47f1-4ef7-abbf-c41a6d1774b8'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:59 devstack cinder-volume[85889]: WARNING cinder.quota [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-711018299 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-711018299, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:07:59 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Created reservations ['e282aaf0-5083-4716-9657-fbef7a270cc9', 'cac342e0-0ed7-40c3-937a-d8cd12421fd4', '202145d4-84d6-4e02-ae27-c01ff8ba01f9', '96d2a453-88b3-4d43-89b9-aafe95f22341'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:07:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:07:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:07:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:07:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:07:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:07:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:07:59 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:07:59 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:07:59 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Sep 17 17:07:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.314s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:07:59 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:07:59 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-cbe10793-0e73-4187-857a-9b6b3665c947 tempest-GroupSnapshotsV319Test-1810067822 None] Delete group completed successfully. Sep 17 17:08:03 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:08:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Flow 'volume_create_manager' (7fe80580-b537-47cc-899f-fdc977597be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:08:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6957450-5d15-44bd-a4e8-19b8280510dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6957450-5d15-44bd-a4e8-19b8280510dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1616901364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0102dad0fd2c4a1ba4d28d921ca01377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:08:04Z,use_quota=True,user_id='0d56bb0ad8df475eacc2f86eddfbd086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3d9fff-a485-4e2d-8ac2-d53cfebc3922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3d9fff-a485-4e2d-8ac2-d53cfebc3922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1873b206-2bed-4026-bf40-3d0cda976fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1873b206-2bed-4026-bf40-3d0cda976fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd', 'volume_name': 'volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c847c273-dd93-4e69-afd4-4005cae11428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c847c273-dd93-4e69-afd4-4005cae11428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf64fad-0433-4524-8a4f-590b56e373b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:04 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Volume 1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd', 'volume_size': 1} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1616901364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0102dad0fd2c4a1ba4d28d921ca01377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:08:04Z,use_quota=True,user_id='0d56bb0ad8df475eacc2f86eddfbd086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Creating volume 1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:08:04 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:04 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd 1073741824 Sep 17 17:08:04 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:04 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd 1073741824" returned: 0 in 0.774s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:04 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd Sep 17 17:08:04 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:05 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd" returned: 0 in 0.382s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:08:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf64fad-0433-4524-8a4f-590b56e373b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6128ae52-89d6-4ca5-94e6-48267bee7a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:05 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Volume volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd (1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd): created successfully Sep 17 17:08:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6128ae52-89d6-4ca5-94e6-48267bee7a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Flow 'volume_create_manager' (7fe80580-b537-47cc-899f-fdc977597be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:08:05 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7269ecd6-52c7-4aee-a5e6-62b1e777f86e tempest-AttachVolumeShelveTestJSON-1953313607 None] Created volume successfully. Sep 17 17:08:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-04160816-06f0-446a-addd-fabdb8f9e2a0 tempest-GroupsV314Test-1020663950 None] Group tempest-GroupsV314Test-Group-507611479: creating Sep 17 17:08:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-04160816-06f0-446a-addd-fabdb8f9e2a0 tempest-GroupsV314Test-1020663950 None] Group tempest-GroupsV314Test-Group-507611479: created successfully Sep 17 17:08:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-04160816-06f0-446a-addd-fabdb8f9e2a0 tempest-GroupsV314Test-1020663950 None] Create group completed successfully. Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Flow 'volume_create_manager' (250bcdf0-2b30-40db-ae25-654b6b3c426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4764f9e5-263d-4dee-b2cf-96dbeb37e907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4764f9e5-263d-4dee-b2cf-96dbeb37e907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-763160645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e3fb1d8-820c-40a2-b307-ce40d0b7bbeb,host='devstack@QuobyteHD#QuobyteHD',id=85763499-f833-4001-b0b9-9efdd21593d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956a28b92c9d4c6f968a9ee0a9d6e477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:08:09Z,use_quota=True,user_id='ac2e66cd96674fcebc883dd3a776644e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f046bda6-f252-4d71-a828-6822e5385d9f),volume_type_id=f046bda6-f252-4d71-a828-6822e5385d9f)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b44f1e2-17fe-4a69-82dc-ea2e5107e91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b44f1e2-17fe-4a69-82dc-ea2e5107e91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c4a8b6-1dae-406a-a892-8b41721e6547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c4a8b6-1dae-406a-a892-8b41721e6547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85763499-f833-4001-b0b9-9efdd21593d2', 'volume_name': 'volume-85763499-f833-4001-b0b9-9efdd21593d2', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0be1df-a8a0-4df5-83cf-062d06805593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0be1df-a8a0-4df5-83cf-062d06805593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ef539e-e313-45c5-92a3-b43019f6c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:09 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Volume 85763499-f833-4001-b0b9-9efdd21593d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85763499-f833-4001-b0b9-9efdd21593d2', 'volume_size': 1} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e3fb1d8-820c-40a2-b307-ce40d0b7bbeb,created_at=2026-09-17T15:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-763160645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e3fb1d8-820c-40a2-b307-ce40d0b7bbeb,host='devstack@QuobyteHD#QuobyteHD',id=85763499-f833-4001-b0b9-9efdd21593d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956a28b92c9d4c6f968a9ee0a9d6e477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:08:09Z,use_quota=True,user_id='ac2e66cd96674fcebc883dd3a776644e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f046bda6-f252-4d71-a828-6822e5385d9f),volume_type_id=f046bda6-f252-4d71-a828-6822e5385d9f)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Creating volume 85763499-f833-4001-b0b9-9efdd21593d2 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:08:09 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:08:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:09 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 1073741824 Sep 17 17:08:09 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:10 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 1073741824" returned: 0 in 0.697s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:10 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 Sep 17 17:08:10 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:10 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2" returned: 0 in 0.296s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:08:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ef539e-e313-45c5-92a3-b43019f6c1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85763499-f833-4001-b0b9-9efdd21593d2', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc30c036-2f41-4a6a-aefc-e8f8a66c0261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:10 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Volume volume-85763499-f833-4001-b0b9-9efdd21593d2 (85763499-f833-4001-b0b9-9efdd21593d2): created successfully Sep 17 17:08:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc30c036-2f41-4a6a-aefc-e8f8a66c0261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Flow 'volume_create_manager' (250bcdf0-2b30-40db-ae25-654b6b3c426f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:08:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-fe0cbfd6-4544-4183-906d-dfb9538d7022 tempest-GroupsV314Test-1020663950 None] Created volume successfully. Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Flow 'volume_create_manager' (22315686-3e3c-4297-a012-aafa2d7f4a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b52e21-43bc-4a33-a544-b832dfca8693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b52e21-43bc-4a33-a544-b832dfca8693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1850727140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6890f61-62d6-4351-8b3b-4c632aedbe6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7993c55c8e40658c84ab0b48b68c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:08:11Z,use_quota=True,user_id='8511c35b96db4781a0ec0a037ca7cc43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e1d38-b2de-494a-99a5-e89591d9f265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e1d38-b2de-494a-99a5-e89591d9f265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45de02a1-5acb-4f03-8b91-49d9f7e7bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45de02a1-5acb-4f03-8b91-49d9f7e7bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6890f61-62d6-4351-8b3b-4c632aedbe6d', 'volume_name': 'volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e048a297-bf3b-4091-88bb-33a8d076e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e048a297-bf3b-4091-88bb-33a8d076e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4406a401-a0d5-4bdd-9dd8-f1ee7ee6ea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:11 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Volume f6890f61-62d6-4351-8b3b-4c632aedbe6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d', 'volume_size': 1} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1850727140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6890f61-62d6-4351-8b3b-4c632aedbe6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7993c55c8e40658c84ab0b48b68c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:08:11Z,use_quota=True,user_id='8511c35b96db4781a0ec0a037ca7cc43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Creating volume f6890f61-62d6-4351-8b3b-4c632aedbe6d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:08:11 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:08:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:11 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d 1073741824 Sep 17 17:08:11 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:12 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d 1073741824" returned: 0 in 0.535s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:12 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d Sep 17 17:08:12 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:12 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d" returned: 0 in 0.298s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4406a401-a0d5-4bdd-9dd8-f1ee7ee6ea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa312b3-dda1-4275-beeb-f91ee78cbad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:12 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Volume volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d (f6890f61-62d6-4351-8b3b-4c632aedbe6d): created successfully Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa312b3-dda1-4275-beeb-f91ee78cbad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Flow 'volume_create_manager' (22315686-3e3c-4297-a012-aafa2d7f4a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:08:12 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-21f4210a-ecaf-441d-b787-d20b4856249d tempest-VolumesServicesTestJSON-1254849267 None] Created volume successfully. Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:12 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Cloning volume 85763499-f833-4001-b0b9-9efdd21593d2 to volume 23fc600a-6bce-46f1-997a-599e652e1869 Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Creating offline snapshot 273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 of volume 85763499-f833-4001-b0b9-9efdd21593d2 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd37a9b8-c399-43b7-85da-a17024535877]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:13 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 Sep 17 17:08:13 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:13 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2" returned: 0 in 0.399s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:13 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 1G Sep 17 17:08:13 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Acquiring lock "cinder-f6890f61-62d6-4351-8b3b-4c632aedbe6d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:13 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 1G" returned: 0 in 0.492s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85763499-f833-4001-b0b9-9efdd21593d2 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Lock "cinder-f6890f61-62d6-4351-8b3b-4c632aedbe6d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:13 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85763499-f833-4001-b0b9-9efdd21593d2 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 Sep 17 17:08:13 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Acquiring lock "cinder-quobyte-f6890f61-62d6-4351-8b3b-4c632aedbe6d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Lock "cinder-quobyte-f6890f61-62d6-4351-8b3b-4c632aedbe6d" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:13 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[878e6a7e-0d55-46b6-82ca-c75e8195f286]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:14 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d Sep 17 17:08:14 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:14 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85763499-f833-4001-b0b9-9efdd21593d2 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506" returned: 0 in 0.500s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:14 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:14 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 Sep 17 17:08:14 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:14 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d" returned: 0 in 0.591s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:14 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d Sep 17 17:08:14 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:14 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506" returned: 0 in 0.361s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:14 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.info Sep 17 17:08:14 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:14 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f6890f61-62d6-4351-8b3b-4c632aedbe6d" returned: 0 in 0.304s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Lock "cinder-quobyte-f6890f61-62d6-4351-8b3b-4c632aedbe6d" released by "delete_volume" :: held 0.945s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Created reservations ['59d33e27-5052-445f-941f-4b8cd2cc61c4', 'cb8658fe-dd92-4d37-8eef-7ea14ed841c0', 'd7711b7d-1168-496b-b771-7180e6db846b', '8689571e-45f0-4a10-9980-a9d61d0e6f5e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:15 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:08:15 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:15 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.info" returned: 0 in 0.341s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:15 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:15 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.info Sep 17 17:08:15 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:15 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.274s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:08:15 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Deleted volume successfully. Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-013a35f8-39ba-4886-8f9d-acbbde5bffbd tempest-VolumesServicesTestJSON-1254849267 None] Lock "cinder-f6890f61-62d6-4351-8b3b-4c632aedbe6d-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:15 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.info" returned: 0 in 0.282s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Acquiring lock "cinder-quobyte-23fc600a-6bce-46f1-997a-599e652e1869" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Lock "cinder-quobyte-23fc600a-6bce-46f1-997a-599e652e1869" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] snapshot: 273cf96f-bcf4-4b7a-a27a-fb03e0d1f506, volume: 23fc600a-6bce-46f1-997a-599e652e1869, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c69f8aa-c9d9-4292-bdb4-6e9b55afc14d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:15 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 Sep 17 17:08:15 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-a5f41505-dff0-4350-b62c-85826759859e req-36fa3a03-b2dd-4b7b-8df4-8b2de3dc3464 tempest-AttachVolumeShelveTestJSON-1953313607 None] No connector for attachment dff18d47-0121-4fcc-a415-1288cc85ad0c; skipping storage backend terminate_connection call. {{(pid=85889) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-a5f41505-dff0-4350-b62c-85826759859e req-36fa3a03-b2dd-4b7b-8df4-8b2de3dc3464 tempest-AttachVolumeShelveTestJSON-1953313607 None] Deleting attachment dff18d47-0121-4fcc-a415-1288cc85ad0c. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:08:15 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506" returned: 0 in 0.366s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85763499-f833-4001-b0b9-9efdd21593d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ac5bcc-e570-466f-a0b5-b66710466fe9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:15 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 Sep 17 17:08:15 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:16 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2" returned: 0 in 0.482s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:08:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:08:16 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:08:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:16 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 Sep 17 17:08:16 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:22 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:08:22 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:22 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.477s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:08:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:08:25 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=51,cinder:UPDATE=46,cinder:DELETE=3,cinder:INSERT=7 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:08:25 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=49,cinder:UPDATE=44,cinder:INSERT=14,cinder:DELETE=2 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:08:26 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869" returned: 0 in 10.161s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2, size 1024.00 MB, duration 10.16 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:08:26 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Converted 1024.00 MB image at 100.77 MB/s Sep 17 17:08:26 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:26 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 Sep 17 17:08:26 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:26 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869" returned: 0 in 0.400s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Lock "cinder-quobyte-23fc600a-6bce-46f1-997a-599e652e1869" released by "_copy_volume_from_snapshot" :: held 11.488s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Acquiring lock "cinder-quobyte-273cf96f-bcf4-4b7a-a27a-fb03e0d1f506" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Lock "cinder-quobyte-273cf96f-bcf4-4b7a-a27a-fb03e0d1f506" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Deleting offline snapshot 273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 of volume 85763499-f833-4001-b0b9-9efdd21593d2 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] snapshot_file for this snap is: volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42bb308-13ed-44c3-a511-9c343234be9e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:27 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 Sep 17 17:08:27 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:27 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506" returned: 0 in 0.538s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85763499-f833-4001-b0b9-9efdd21593d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:08:27 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba72c783-07a8-4f4c-a833-6c87b18a87d7]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:27 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 Sep 17 17:08:27 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:28 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2" returned: 0 in 0.700s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:28 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 Sep 17 17:08:28 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:28 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-5a3879a4-df9d-4523-8ae2-8166be845282 req-ca07177a-7092-47f2-9110-086ec801204e tempest-TestMinimumBasicScenario-1546616019 None] Terminate volume connection completed successfully. Sep 17 17:08:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-5a3879a4-df9d-4523-8ae2-8166be845282 req-ca07177a-7092-47f2-9110-086ec801204e tempest-TestMinimumBasicScenario-1546616019 None] Deleting attachment b0a90d80-22fd-4ffc-aed2-c2e5c1530ced. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:08:28 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506" returned: 0 in 0.480s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:28 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506 Sep 17 17:08:28 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Acquiring lock "cinder-36868042-e8df-49d1-b2f0-9de2ad648e01-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:29 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2.273cf96f-bcf4-4b7a-a27a-fb03e0d1f506" returned: 0 in 0.375s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Lock "cinder-36868042-e8df-49d1-b2f0-9de2ad648e01-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Lock "cinder-quobyte-273cf96f-bcf4-4b7a-a27a-fb03e0d1f506" released by "_delete_snapshot" :: held 2.288s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.386s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Acquiring lock "cinder-quobyte-36868042-e8df-49d1-b2f0-9de2ad648e01" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Lock "cinder-quobyte-36868042-e8df-49d1-b2f0-9de2ad648e01" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc6ffa0-d35d-43a1-9973-22a20485d9b0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:29 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0bd8e234-af5f-4ef5-aa8d-edfee742544b tempest-GroupsV314Test-1020663950 None] Create group from source-group-7e3fb1d8-820c-40a2-b307-ce40d0b7bbeb completed successfully. Sep 17 17:08:29 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01 Sep 17 17:08:29 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:29 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01" returned: 0 in 0.436s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:29 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01 Sep 17 17:08:29 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:30 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36868042-e8df-49d1-b2f0-9de2ad648e01" returned: 0 in 0.311s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Lock "cinder-quobyte-36868042-e8df-49d1-b2f0-9de2ad648e01" released by "delete_volume" :: held 0.805s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Created reservations ['859534ec-9e86-4ff6-807b-4cb2f37afeec', 'b802a65b-75da-4877-ad7a-568ae128bae1', '3830ff66-a048-4d64-9ca2-52f965b3d062', '7a8b9ce4-ac94-4804-844e-4df40e1727cd'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:30 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:08:30 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Acquiring lock "cinder-quobyte-23fc600a-6bce-46f1-997a-599e652e1869" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Lock "cinder-quobyte-23fc600a-6bce-46f1-997a-599e652e1869" acquired by "delete_volume" :: waited 0.038s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf5faa0-7318-435d-872f-ccf2073caaa6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:30 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.548s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:08:30 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 Sep 17 17:08:30 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Deleted volume successfully. Sep 17 17:08:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4527a3f4-f592-4c26-a786-946cfb0ea503 tempest-TestMinimumBasicScenario-1546616019 None] Lock "cinder-36868042-e8df-49d1-b2f0-9de2ad648e01-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:31 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869" returned: 0 in 0.660s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:31 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869 Sep 17 17:08:31 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:31 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-23fc600a-6bce-46f1-997a-599e652e1869" returned: 0 in 0.556s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Lock "cinder-quobyte-23fc600a-6bce-46f1-997a-599e652e1869" released by "delete_volume" :: held 1.314s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:32 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Created reservations ['a1d540a8-a93b-47e5-828a-3133bc9a0c9f'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:08:32 devstack cinder-volume[85889]: WARNING cinder.quota [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-239405224 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-239405224, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:08:32 devstack cinder-volume[85889]: WARNING cinder.quota [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-239405224 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-239405224, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:08:32 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Created reservations ['4c61eb91-1134-4fe0-8f54-7674182e0e90', '98a06ae2-0d59-4c83-84b2-3b582ef641b5', 'fb1a109c-ac89-4bd8-870b-4fc37ff19fb9', '860874e0-fd6a-481e-beee-18aa48a413e8'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:08:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:08:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:08:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:32 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:08:32 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:32 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.381s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:32 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:08:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3d0d5aae-71db-428f-9c94-0ccc301130ca tempest-GroupsV314Test-1020663950 None] Delete group completed successfully. Sep 17 17:08:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Acquiring lock "cinder-quobyte-85763499-f833-4001-b0b9-9efdd21593d2" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Lock "cinder-quobyte-85763499-f833-4001-b0b9-9efdd21593d2" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:33 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d0a260-b4fa-42be-bcd4-51932e1d3ce8]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:33 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 Sep 17 17:08:33 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:34 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2" returned: 0 in 0.679s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:34 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2 Sep 17 17:08:34 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:34 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-85763499-f833-4001-b0b9-9efdd21593d2" returned: 0 in 0.603s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Lock "cinder-quobyte-85763499-f833-4001-b0b9-9efdd21593d2" released by "delete_volume" :: held 1.407s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:35 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Created reservations ['09a2ed6f-9f7c-469e-bae4-c0d3c25b174b'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:08:35 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Created reservations ['1da8da3b-1d4d-4265-8ccd-c6c536d3e5ea', 'a355380f-df45-4fc8-9455-fc599a834f49', 'fefc8014-ebd1-4820-9dcb-41fbd6d4be67', '6435e12d-c693-4852-a6ce-92d272616e3d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:08:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:08:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:08:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:35 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:08:35 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:35 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.334s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:35 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:08:35 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-fbc67ff5-7f71-48f6-9e94-b9f88dac25c0 tempest-GroupsV314Test-1020663950 None] Delete group completed successfully. Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Flow 'volume_create_manager' (ef0d5d08-83ae-4beb-ac28-b11085c4ea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4c1dcd-a3af-4412-82a6-98846dcaa445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4c1dcd-a3af-4412-82a6-98846dcaa445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-156467441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d05d14d-895c-4bcd-86ce-7ce196d3896d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c50621a0bdf489fa0aeef1d2f7db8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:08:45Z,use_quota=True,user_id='6ae7c88b042c42de9ff2dd948f3631f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7531eb6a-bea5-400d-90b3-628d70393157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7531eb6a-bea5-400d-90b3-628d70393157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e969e9-b66f-4506-b977-62b4128c1ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e969e9-b66f-4506-b977-62b4128c1ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d05d14d-895c-4bcd-86ce-7ce196d3896d', 'volume_name': 'volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0c3088-06bd-49a5-8553-159a688bdf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0c3088-06bd-49a5-8553-159a688bdf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1881cf2-533b-4a80-a635-e10cadd6909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:45 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d', 'volume_size': 1} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-156467441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d05d14d-895c-4bcd-86ce-7ce196d3896d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c50621a0bdf489fa0aeef1d2f7db8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:08:45Z,use_quota=True,user_id='6ae7c88b042c42de9ff2dd948f3631f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Creating volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:08:45 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:45 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d 1073741824 Sep 17 17:08:45 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:45 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d 1073741824" returned: 0 in 0.645s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:45 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d Sep 17 17:08:45 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:46 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d" returned: 0 in 0.459s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:08:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1881cf2-533b-4a80-a635-e10cadd6909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4364a9b9-e921-4951-8195-e8dba287cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:08:46 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Volume volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d (4d05d14d-895c-4bcd-86ce-7ce196d3896d): created successfully Sep 17 17:08:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4364a9b9-e921-4951-8195-e8dba287cfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:08:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Flow 'volume_create_manager' (ef0d5d08-83ae-4beb-ac28-b11085c4ea8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:08:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-2f6f0288-32de-4691-b4c4-d7b924c2e66a tempest-SnapshotsActionsTest-201962187 None] Created volume successfully. Sep 17 17:08:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Creating offline snapshot 36ddbdcd-f8c0-4e34-9652-03d370509d55 of volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:08:47 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce75fac7-c13e-419d-976b-c2e62f63eb3b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:47 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d Sep 17 17:08:47 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:47 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d" returned: 0 in 0.461s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:48 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 1G Sep 17 17:08:48 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:48 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 1G" returned: 0 in 0.501s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:48 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:08:48 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:48 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.357s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:48 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 is being set with open permissions: ugo+rw Sep 17 17:08:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:48 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:08:48 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:49 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.300s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:49 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.info Sep 17 17:08:49 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:49 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.info" returned: 0 in 0.292s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:49 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.info is being set with open permissions: ugo+rw Sep 17 17:08:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:49 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.info Sep 17 17:08:49 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:49 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.info" returned: 0 in 0.289s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:49 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0de40bf6-0dbf-4b19-8dd6-8ac0e8a77196 tempest-SnapshotsActionsTest-201962187 None] Create snapshot completed successfully Sep 17 17:08:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] Creating offline snapshot 44d745b2-2407-4f7e-8861-c76845213a9f of volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:08:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[777b71f8-8598-4d35-ba47-d7860dcc0004]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:51 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:08:51 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:52 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.461s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:08:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:52 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f 1G Sep 17 17:08:52 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:52 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f 1G" returned: 0 in 0.582s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:52 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f Sep 17 17:08:52 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:53 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:53 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f is being set with open permissions: ugo+rw Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:53 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f Sep 17 17:08:53 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:53 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f" returned: 0 in 0.277s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:53 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-16c4e50d-e820-44d3-b967-d6fceb8acbe3 tempest-SnapshotsActionsTest-201962187 None] Create snapshot completed successfully Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-44d745b2-2407-4f7e-8861-c76845213a9f-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-44d745b2-2407-4f7e-8861-c76845213a9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-quobyte-44d745b2-2407-4f7e-8861-c76845213a9f" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-44d745b2-2407-4f7e-8861-c76845213a9f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Deleting offline snapshot 44d745b2-2407-4f7e-8861-c76845213a9f of volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] snapshot_file for this snap is: volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef6ab2d-dab6-4208-83c5-e66134fdf0be]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:54 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f Sep 17 17:08:54 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:54 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f" returned: 0 in 0.421s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:08:54 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf63ed05-2425-4e8e-9932-672036b00d5c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:54 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:08:54 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:54 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.492s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:08:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:54 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f Sep 17 17:08:54 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:55 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f" returned: 0 in 0.592s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:55 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f Sep 17 17:08:55 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:55 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.44d745b2-2407-4f7e-8861-c76845213a9f" returned: 0 in 0.385s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-44d745b2-2407-4f7e-8861-c76845213a9f" released by "_delete_snapshot" :: held 2.057s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" released by "delete_snapshot" :: held 2.087s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:56 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Created reservations ['7ec5729d-4830-4b53-a5c5-b40185518823', '04dbebd6-bfc3-4fc2-bf8a-3d2cb9b24b3f', 'e89e2bfe-c703-4c71-ac0e-4ab97ab74fae', '9169d0d9-ccd4-499c-917f-13409452b220'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:08:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Delete snapshot completed successfully. Sep 17 17:08:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-659f2d2b-9208-4b24-bc22-e8683ca0d40f tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-44d745b2-2407-4f7e-8861-c76845213a9f-delete_snapshot" released by "delete_snapshot" :: held 2.348s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:08:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:08:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:08:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] Creating offline snapshot a16ce421-4ee6-4e86-89de-8817799676a4 of volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:08:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a560c89-eafc-4fad-a18f-84b9233040fe]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:08:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:57 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:08:57 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:58 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.630s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:08:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:58 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 1G Sep 17 17:08:58 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:58 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 1G" returned: 0 in 0.597s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:58 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 Sep 17 17:08:58 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:59 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4" returned: 0 in 0.372s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:59 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 is being set with open permissions: ugo+rw Sep 17 17:08:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:08:59 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 Sep 17 17:08:59 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:08:59 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 17 17:08:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4" returned: 0 in 0.298s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:08:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:08:59 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c52870cd-7a0e-4929-b275-ff88904f622c tempest-SnapshotsActionsTest-201962187 None] Create snapshot completed successfully Sep 17 17:09:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-a16ce421-4ee6-4e86-89de-8817799676a4-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-a16ce421-4ee6-4e86-89de-8817799676a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-quobyte-a16ce421-4ee6-4e86-89de-8817799676a4" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-a16ce421-4ee6-4e86-89de-8817799676a4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Deleting offline snapshot a16ce421-4ee6-4e86-89de-8817799676a4 of volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:09:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] snapshot_file for this snap is: volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:09:00 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[919c8a2e-ad9c-44db-aee8-6c14cab61a40]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:01 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 Sep 17 17:09:01 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:01 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4" returned: 0 in 0.417s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:09:01 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b378dd-9e9d-42d2-a1cd-3a3cf3ecbc97]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:01 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:09:01 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:01 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.454s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:09:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:01 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 Sep 17 17:09:01 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:02 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4" returned: 0 in 0.535s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:02 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4 Sep 17 17:09:02 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:02 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.a16ce421-4ee6-4e86-89de-8817799676a4" returned: 0 in 0.294s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-a16ce421-4ee6-4e86-89de-8817799676a4" released by "_delete_snapshot" :: held 1.837s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" released by "delete_snapshot" :: held 1.871s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:02 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Created reservations ['e83004d4-f625-4b84-ba6c-00f486cba814', 'dbb4c9f3-5bd1-4078-942d-e6056026fde0', '3311ed69-58e4-4e84-9e18-c2b716a6b1c9', '45164e76-e8cf-4c11-9d03-ec2bb74ce628'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Delete snapshot completed successfully. Sep 17 17:09:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e09430a4-6b2e-4e35-8566-100ecc0cbeb7 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-a16ce421-4ee6-4e86-89de-8817799676a4-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] Creating offline snapshot 7c25123c-21ed-451b-a892-94407807d74c of volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:09:03 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aba4933-d220-4c47-a1cf-203fbec71145]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:03 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:09:03 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:04 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.547s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:09:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:04 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c 1G Sep 17 17:09:04 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:04 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c 1G" returned: 0 in 0.546s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:04 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c Sep 17 17:09:04 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:05 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c" returned: 0 in 0.347s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:05 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c is being set with open permissions: ugo+rw Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:05 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c Sep 17 17:09:05 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:05 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c" returned: 0 in 0.279s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:05 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a4f37cb6-59fe-4d8d-bbad-b68bb2298d27 tempest-SnapshotsActionsTest-201962187 None] Create snapshot completed successfully Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-7c25123c-21ed-451b-a892-94407807d74c-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-7c25123c-21ed-451b-a892-94407807d74c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-quobyte-7c25123c-21ed-451b-a892-94407807d74c" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-7c25123c-21ed-451b-a892-94407807d74c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Deleting offline snapshot 7c25123c-21ed-451b-a892-94407807d74c of volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] snapshot_file for this snap is: volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e5590d-93d4-417f-aa84-081eba117c85]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:05 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c Sep 17 17:09:05 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:06 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c" returned: 0 in 0.478s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:09:06 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b647fb93-76f9-46cc-b198-d4bb7d89cd46]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:06 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:09:06 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:06 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.408s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:09:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:06 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c Sep 17 17:09:06 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:07 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c" returned: 0 in 0.480s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:07 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c Sep 17 17:09:07 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:07 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.7c25123c-21ed-451b-a892-94407807d74c" returned: 0 in 0.340s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-7c25123c-21ed-451b-a892-94407807d74c" released by "_delete_snapshot" :: held 1.859s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" released by "delete_snapshot" :: held 1.890s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:07 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Created reservations ['96ba4d00-5741-4aba-ade0-5983f9e16e67', '1dc48db7-851f-4dcc-9a64-6de5bb996a2d', 'eb9f110e-79e6-4ec1-a5ba-818eb453e746', 'af0f1c39-ac34-44dd-aa89-10c341c5207c'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Delete snapshot completed successfully. Sep 17 17:09:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d04a6fe8-e09f-420d-9866-7773581a5d83 tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-7c25123c-21ed-451b-a892-94407807d74c-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] Creating offline snapshot d30e976e-18d9-4075-b464-c8d61a1a0810 of volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:09:08 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f2248f-e177-4034-a096-6403a26e8baf]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:08 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:09:08 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:08 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.504s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:09:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:09 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 1G Sep 17 17:09:09 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:09 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 1G" returned: 0 in 0.646s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:09 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 Sep 17 17:09:09 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:10 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810" returned: 0 in 0.461s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:10 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 is being set with open permissions: ugo+rw Sep 17 17:09:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:10 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 Sep 17 17:09:10 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:10 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810" returned: 0 in 0.408s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a38c77c8-4be1-45f9-bf3f-d81628a8c811 tempest-SnapshotsActionsTest-201962187 None] Create snapshot completed successfully Sep 17 17:09:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-d30e976e-18d9-4075-b464-c8d61a1a0810-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-d30e976e-18d9-4075-b464-c8d61a1a0810-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Acquiring lock "cinder-quobyte-d30e976e-18d9-4075-b464-c8d61a1a0810" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-d30e976e-18d9-4075-b464-c8d61a1a0810" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Deleting offline snapshot d30e976e-18d9-4075-b464-c8d61a1a0810 of volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:09:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] snapshot_file for this snap is: volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:09:11 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7463d66-8b57-4a30-8361-1314031d7814]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:11 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 Sep 17 17:09:11 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Acquiring lock "cinder-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Lock "cinder-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:12 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810" returned: 0 in 0.522s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Acquiring lock "cinder-quobyte-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb86770d-57c7-4b15-bb44-bf03111a9635]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Lock "cinder-quobyte-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd" acquired by "delete_volume" :: waited 0.034s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e7bb33-ec68-4b41-a683-16d774238057]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:12 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:09:12 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:12 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd Sep 17 17:09:12 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:12 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.479s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:12 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 Sep 17 17:09:12 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:12 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd" returned: 0 in 0.464s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:12 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd Sep 17 17:09:12 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:13 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd" returned: 0 in 0.373s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Lock "cinder-quobyte-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd" released by "delete_volume" :: held 0.905s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:13 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810" returned: 0 in 0.520s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Created reservations ['bbdf98d3-c9c4-41f7-9845-b89a84baa992', '4f24163b-4c06-4859-ab50-3ef23390f98d', 'b37667fe-1277-4d1d-89de-5b93b163d173', '9dcdcf5f-c5e3-46ed-8fdb-725d2ea9bb56'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:13 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810 Sep 17 17:09:13 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:13 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:09:13 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:13 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.d30e976e-18d9-4075-b464-c8d61a1a0810" returned: 0 in 0.418s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-d30e976e-18d9-4075-b464-c8d61a1a0810" released by "_delete_snapshot" :: held 2.095s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" released by "delete_snapshot" :: held 2.127s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:13 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.375s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:09:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Deleted volume successfully. Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-df0ac6c3-36ef-4673-b848-8c71f3d4e686 tempest-AttachVolumeShelveTestJSON-1953313607 None] Lock "cinder-1e2825b4-b7f1-4d04-9f9f-8e74b08f46fd-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Created reservations ['d5677b38-2ac6-4f4c-9016-999b37021232', '7f79b32d-72aa-440f-be92-d32802cab5bc', '3969041d-e12e-4fd1-9538-c663e556fa13', '103df9db-3ecb-4f6a-b85c-b1f7edee7ce5'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Delete snapshot completed successfully. Sep 17 17:09:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-24055980-1240-4ca8-bc1e-1fb1fd90324e tempest-SnapshotsActionsTest-774148254 None] Lock "cinder-d30e976e-18d9-4075-b464-c8d61a1a0810-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "cinder-36ddbdcd-f8c0-4e34-9652-03d370509d55-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Lock "cinder-36ddbdcd-f8c0-4e34-9652-03d370509d55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "cinder-quobyte-36ddbdcd-f8c0-4e34-9652-03d370509d55" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Lock "cinder-quobyte-36ddbdcd-f8c0-4e34-9652-03d370509d55" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Deleting offline snapshot 36ddbdcd-f8c0-4e34-9652-03d370509d55 of volume 4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:09:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] snapshot_file for this snap is: volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:09:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb7955f-4aa6-408e-a6d7-75baf0b651c4]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:15 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:09:15 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:16 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.479s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:09:16 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50af8ab-87ce-4274-b087-31fd30f2b3d8]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:16 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d Sep 17 17:09:16 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:16 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d" returned: 0 in 0.407s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:16 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:09:16 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:17 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.441s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:17 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55 Sep 17 17:09:17 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:17 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d.36ddbdcd-f8c0-4e34-9652-03d370509d55" returned: 0 in 0.281s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Lock "cinder-quobyte-36ddbdcd-f8c0-4e34-9652-03d370509d55" released by "_delete_snapshot" :: held 1.779s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" released by "delete_snapshot" :: held 1.836s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Created reservations ['a06aea06-1f75-4f95-ae89-554a8c18445b', 'ffb99bb6-667e-49dd-9dc3-ebd7835366a5', '67450638-9dfa-4a28-9a13-4ce0215b8e61', '5561ae49-292d-490b-842b-1da885b8b4fc'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:17 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Delete snapshot completed successfully. Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4738ea26-3aef-48fb-b67d-fc131f493f8f tempest-SnapshotsActionsTest-201962187 None] Lock "cinder-36ddbdcd-f8c0-4e34-9652-03d370509d55-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "cinder-4d05d14d-895c-4bcd-86ce-7ce196d3896d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Lock "cinder-4d05d14d-895c-4bcd-86ce-7ce196d3896d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[29df87c5-316e-495f-94db-0f8f5a0332f4]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:18 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d Sep 17 17:09:18 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:18 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d" returned: 0 in 0.415s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:18 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d Sep 17 17:09:18 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:18 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4d05d14d-895c-4bcd-86ce-7ce196d3896d" returned: 0 in 0.281s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Lock "cinder-quobyte-4d05d14d-895c-4bcd-86ce-7ce196d3896d" released by "delete_volume" :: held 0.796s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Created reservations ['3132ab2c-06de-4b4a-991c-93210ed9ee9b', '1b962e08-feb4-4abd-8ea5-1d7ffa45c0f8', '8de6659e-51df-473a-a19b-988056d9a53a', 'e48cf4bf-0c4f-45a5-b905-5e18a0ca44ef'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:18 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:09:18 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:19 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.293s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:19 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:09:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Deleted volume successfully. Sep 17 17:09:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4e777120-e9ed-47bb-8893-7efb32cc54ce tempest-SnapshotsActionsTest-201962187 None] Lock "cinder-4d05d14d-895c-4bcd-86ce-7ce196d3896d-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:22 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:09:22 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:22 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.332s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:09:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=81,cinder:UPDATE=86,cinder:INSERT=20,cinder:DELETE=3 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=85,cinder:SELECT=67,cinder:INSERT=24,cinder:DELETE=6 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Flow 'volume_create_manager' (2ad467a8-0ee0-4ad3-ba5c-5878615e889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee3723b-eaf8-4203-ba04-001c3572fe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee3723b-eaf8-4203-ba04-001c3572fe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1116864195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c310164-5350-46f9-b22b-137bfb6b1326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3386a7019d704b8087e9c5f89932ec24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:28Z,use_quota=True,user_id='8d91c3404c4749648aa7346c6a63ce3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b3c20c-14a8-4ddc-a2f7-51c7b1a8a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b3c20c-14a8-4ddc-a2f7-51c7b1a8a280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0d92ca-45e9-44dd-93b1-12724b7e80cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0d92ca-45e9-44dd-93b1-12724b7e80cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c310164-5350-46f9-b22b-137bfb6b1326', 'volume_name': 'volume-5c310164-5350-46f9-b22b-137bfb6b1326', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f768ce-fcf2-4f40-9c0a-230b8c4b6f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f768ce-fcf2-4f40-9c0a-230b8c4b6f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c49d7b8-7385-431f-908a-1da482c045c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:28 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Volume 5c310164-5350-46f9-b22b-137bfb6b1326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c310164-5350-46f9-b22b-137bfb6b1326', 'volume_size': 1} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1116864195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c310164-5350-46f9-b22b-137bfb6b1326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3386a7019d704b8087e9c5f89932ec24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:28Z,use_quota=True,user_id='8d91c3404c4749648aa7346c6a63ce3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Creating volume 5c310164-5350-46f9-b22b-137bfb6b1326 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:09:28 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:09:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:28 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 1073741824 Sep 17 17:09:28 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:29 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 1073741824" returned: 0 in 0.975s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:29 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 Sep 17 17:09:29 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:30 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326" returned: 0 in 0.604s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c49d7b8-7385-431f-908a-1da482c045c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c310164-5350-46f9-b22b-137bfb6b1326', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0dfb1f-7c75-4924-b6b5-4e45f91298af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Volume volume-5c310164-5350-46f9-b22b-137bfb6b1326 (5c310164-5350-46f9-b22b-137bfb6b1326): created successfully Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0dfb1f-7c75-4924-b6b5-4e45f91298af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Flow 'volume_create_manager' (2ad467a8-0ee0-4ad3-ba5c-5878615e889b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a2f80f5c-b3ac-41a6-b573-9470f3b72ccd tempest-TestStampPattern-1882177794 None] Created volume successfully. Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (a9d077f0-1136-4515-a15d-947c10a0f32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4497c026-8a76-4528-a155-1fd237f495f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4497c026-8a76-4528-a155-1fd237f495f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1999099428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7cd37f-9b6d-4f50-8353-386b0f7e427d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:30Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb5768b-136f-4aee-ab50-75fdff0f74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb5768b-136f-4aee-ab50-75fdff0f74fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073bed8e-2022-4fae-a2e8-ff0e43bd5df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073bed8e-2022-4fae-a2e8-ff0e43bd5df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7cd37f-9b6d-4f50-8353-386b0f7e427d', 'volume_name': 'volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb81e03-d338-4e75-81b3-ada747570d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb81e03-d338-4e75-81b3-ada747570d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a51ef69-4621-48ca-8682-0e5058dc1d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Volume fc7cd37f-9b6d-4f50-8353-386b0f7e427d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d', 'volume_size': 1} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1999099428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7cd37f-9b6d-4f50-8353-386b0f7e427d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:30Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Creating volume fc7cd37f-9b6d-4f50-8353-386b0f7e427d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:09:30 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:09:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:30 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d 1073741824 Sep 17 17:09:30 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:31 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d 1073741824" returned: 0 in 0.680s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:31 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d Sep 17 17:09:31 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:31 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d" returned: 0 in 0.397s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:09:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a51ef69-4621-48ca-8682-0e5058dc1d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83b1af8-161a-49d7-a364-5eed10ae5b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:31 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Volume volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d (fc7cd37f-9b6d-4f50-8353-386b0f7e427d): created successfully Sep 17 17:09:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83b1af8-161a-49d7-a364-5eed10ae5b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (a9d077f0-1136-4515-a15d-947c10a0f32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-719f75e7-1871-4401-b510-8476d9fa8276 tempest-VolumesActionsTest-1762064101 None] Created volume successfully. Sep 17 17:09:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4255ffd2-6b10-4c5c-af5d-fada2174c7d9 tempest-VolumesActionsTest-1762064101 None] Acquiring lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d" by "attach_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4255ffd2-6b10-4c5c-af5d-fada2174c7d9 tempest-VolumesActionsTest-1762064101 None] Lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d" acquired by "attach_volume" :: waited 0.063s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4255ffd2-6b10-4c5c-af5d-fada2174c7d9 tempest-VolumesActionsTest-1762064101 None] Attaching volume fc7cd37f-9b6d-4f50-8353-386b0f7e427d to instance 5cc88da2-c158-4973-bfd3-d8c9726e849e at mountpoint /dev/vdb on host None. Sep 17 17:09:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4255ffd2-6b10-4c5c-af5d-fada2174c7d9 tempest-VolumesActionsTest-1762064101 None] Attach volume completed successfully. Sep 17 17:09:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4255ffd2-6b10-4c5c-af5d-fada2174c7d9 tempest-VolumesActionsTest-1762064101 None] Lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d" released by "attach_volume" :: held 0.292s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Flow 'volume_create_manager' (d13cafe7-fd90-43e1-a093-aea0ca27f065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c881ef77-af3d-45f1-8131-6b9b3789ea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c881ef77-af3d-45f1-8131-6b9b3789ea07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1753971686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951f4e38-4d20-49fd-9013-28d362291a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a374ea082314ba38ae1fb581636107c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:33Z,use_quota=True,user_id='c6b1f604b8c94c988f58aa47f7d4d706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42555f59-3cf8-4e29-aed9-51a3a7643e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42555f59-3cf8-4e29-aed9-51a3a7643e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e7f725-fb6d-4b8f-8873-411d2a3ca3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e7f725-fb6d-4b8f-8873-411d2a3ca3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '951f4e38-4d20-49fd-9013-28d362291a19', 'volume_name': 'volume-951f4e38-4d20-49fd-9013-28d362291a19', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48b7bfb-3e23-4929-a1ee-01236a934ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48b7bfb-3e23-4929-a1ee-01236a934ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a66567-5859-435a-a818-650d807b5bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:33 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Volume 951f4e38-4d20-49fd-9013-28d362291a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-951f4e38-4d20-49fd-9013-28d362291a19', 'volume_size': 1} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1753971686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951f4e38-4d20-49fd-9013-28d362291a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a374ea082314ba38ae1fb581636107c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:33Z,use_quota=True,user_id='c6b1f604b8c94c988f58aa47f7d4d706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Creating volume 951f4e38-4d20-49fd-9013-28d362291a19 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:09:33 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:33 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19 1073741824 Sep 17 17:09:33 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:33 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19 1073741824" returned: 0 in 0.700s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:34 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19 Sep 17 17:09:34 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-febf136a-56d8-494f-9637-b3654cee9c21 tempest-VolumesActionsTest-182052595 None] Terminate volume connection completed successfully. Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-febf136a-56d8-494f-9637-b3654cee9c21 tempest-VolumesActionsTest-182052595 None] Acquiring lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d-detach_volume" by "detach_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-febf136a-56d8-494f-9637-b3654cee9c21 tempest-VolumesActionsTest-182052595 None] Lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-febf136a-56d8-494f-9637-b3654cee9c21 tempest-VolumesActionsTest-182052595 None] Detaching volume fc7cd37f-9b6d-4f50-8353-386b0f7e427d from instance 5cc88da2-c158-4973-bfd3-d8c9726e849e. Sep 17 17:09:34 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19" returned: 0 in 0.599s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-febf136a-56d8-494f-9637-b3654cee9c21 tempest-VolumesActionsTest-182052595 None] Detach volume completed successfully. Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a66567-5859-435a-a818-650d807b5bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951f4e38-4d20-49fd-9013-28d362291a19', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed49b75e-4703-4d67-bfaf-02c572e89b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-febf136a-56d8-494f-9637-b3654cee9c21 tempest-VolumesActionsTest-182052595 None] Lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d-detach_volume" released by "detach_volume" :: held 0.211s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:34 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Volume volume-951f4e38-4d20-49fd-9013-28d362291a19 (951f4e38-4d20-49fd-9013-28d362291a19): created successfully Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed49b75e-4703-4d67-bfaf-02c572e89b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Flow 'volume_create_manager' (d13cafe7-fd90-43e1-a093-aea0ca27f065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d336a8c4-48ac-46b2-81e4-03bc8d0c1d4a tempest-VolumeQuotasAdminTestJSON-469146946 None] Created volume successfully. Sep 17 17:09:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-aab6012a-8155-47f5-935c-fd59a2b5e41a tempest-VolumesActionsTest-1762064101 None] Acquiring lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d-detach_volume" by "detach_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-aab6012a-8155-47f5-935c-fd59a2b5e41a tempest-VolumesActionsTest-1762064101 None] Lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:35 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-aab6012a-8155-47f5-935c-fd59a2b5e41a tempest-VolumesActionsTest-1762064101 None] Volume detach called, but volume not attached. Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-aab6012a-8155-47f5-935c-fd59a2b5e41a tempest-VolumesActionsTest-1762064101 None] Lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Acquiring lock "cinder-951f4e38-4d20-49fd-9013-28d362291a19-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "cinder-951f4e38-4d20-49fd-9013-28d362291a19-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Acquiring lock "cinder-quobyte-951f4e38-4d20-49fd-9013-28d362291a19" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "cinder-quobyte-951f4e38-4d20-49fd-9013-28d362291a19" acquired by "delete_volume" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3979bb4c-2187-463a-93b5-e4b15e25ab3e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Acquiring lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Acquiring lock "cinder-quobyte-fc7cd37f-9b6d-4f50-8353-386b0f7e427d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Lock "cinder-quobyte-fc7cd37f-9b6d-4f50-8353-386b0f7e427d" acquired by "delete_volume" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[95219ef5-3d31-407a-ba3f-4ea358604f2e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:35 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19 Sep 17 17:09:35 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:35 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d Sep 17 17:09:35 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:36 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d" returned: 0 in 0.523s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:36 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d Sep 17 17:09:36 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:36 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19" returned: 0 in 0.837s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:36 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19 Sep 17 17:09:36 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:36 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fc7cd37f-9b6d-4f50-8353-386b0f7e427d" returned: 0 in 0.630s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Lock "cinder-quobyte-fc7cd37f-9b6d-4f50-8353-386b0f7e427d" released by "delete_volume" :: held 1.245s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:36 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-951f4e38-4d20-49fd-9013-28d362291a19" returned: 0 in 0.660s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "cinder-quobyte-951f4e38-4d20-49fd-9013-28d362291a19" released by "delete_volume" :: held 1.558s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:36 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Created reservations ['4165c1e6-5cd7-43b3-af7a-9558535477ce', '7f429efa-4ffb-425a-ac9f-ac43f8b6a8ca', '4cd3a05a-06b1-42a8-8ede-3f63aae0827c', 'c121edb7-2cad-4f77-810b-c83d3b0f900c'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Created reservations ['6accfe27-96e8-4167-b2ba-b06a2fbd23ea', '1f1cbf76-d5d3-4a63-9959-82788f93497b', 'c526058e-775f-455d-8035-7a262b54bd4e', '5e6c47f5-19ae-4399-83a6-12a63920dcb5'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:37 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:09:37 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:37 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:09:37 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:37 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.470s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:09:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Deleted volume successfully. Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f27fa0c0-b159-4f03-acac-7131ff1129b7 tempest-VolumesActionsTest-1762064101 None] Lock "cinder-fc7cd37f-9b6d-4f50-8353-386b0f7e427d-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:37 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.579s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:37 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:09:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Deleted volume successfully. Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-71e192bb-3200-4248-b782-73628780ab52 tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "cinder-951f4e38-4d20-49fd-9013-28d362291a19-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Flow 'volume_create_manager' (d6d6b0ae-1648-4de2-8b2e-9c4d77095d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83cc8990-0e7d-46f9-8757-1a1a44d5e670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83cc8990-0e7d-46f9-8757-1a1a44d5e670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-962663264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61d5962-9a7b-4d7d-a5cc-2a54bf380696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a374ea082314ba38ae1fb581636107c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:39Z,use_quota=True,user_id='c6b1f604b8c94c988f58aa47f7d4d706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e358e1dd-8baa-4c5a-b1f9-43393ef33ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e358e1dd-8baa-4c5a-b1f9-43393ef33ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa79a3b-e534-4293-9aab-10f992ef39fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa79a3b-e534-4293-9aab-10f992ef39fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e61d5962-9a7b-4d7d-a5cc-2a54bf380696', 'volume_name': 'volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1659cc-a807-4450-8570-bc7f2f8e9e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1659cc-a807-4450-8570-bc7f2f8e9e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff5eb74-67b6-4e39-b043-89b99727d4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:38 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Volume e61d5962-9a7b-4d7d-a5cc-2a54bf380696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696', 'volume_size': 1} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-962663264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61d5962-9a7b-4d7d-a5cc-2a54bf380696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a374ea082314ba38ae1fb581636107c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:39Z,use_quota=True,user_id='c6b1f604b8c94c988f58aa47f7d4d706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Creating volume e61d5962-9a7b-4d7d-a5cc-2a54bf380696 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:09:38 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:09:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:39 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696 1073741824 Sep 17 17:09:39 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:39 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696 1073741824" returned: 0 in 0.970s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:39 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696 Sep 17 17:09:39 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:40 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696" returned: 0 in 0.483s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:09:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff5eb74-67b6-4e39-b043-89b99727d4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218d0977-f801-492f-bf42-01634d99b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:40 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Volume volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696 (e61d5962-9a7b-4d7d-a5cc-2a54bf380696): created successfully Sep 17 17:09:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218d0977-f801-492f-bf42-01634d99b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Flow 'volume_create_manager' (d6d6b0ae-1648-4de2-8b2e-9c4d77095d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-74aeda83-8697-4340-a903-81a7438b3ac3 tempest-VolumeQuotasAdminTestJSON-469146946 None] Created volume successfully. Sep 17 17:09:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-58dd4e4b-d611-4b02-813a-c78a213e7d2c tempest-VolumeQuotasAdminTestJSON-1600353304 None] Transfer volume completed successfully. Sep 17 17:09:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Acquiring lock "cinder-e61d5962-9a7b-4d7d-a5cc-2a54bf380696-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Lock "cinder-e61d5962-9a7b-4d7d-a5cc-2a54bf380696-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Acquiring lock "cinder-quobyte-e61d5962-9a7b-4d7d-a5cc-2a54bf380696" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Lock "cinder-quobyte-e61d5962-9a7b-4d7d-a5cc-2a54bf380696" acquired by "delete_volume" :: waited 0.045s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9724e61-e8b4-47c8-a8b6-e8eea91a15c7]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (e214e497-6715-4695-9455-92662e67a6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9683ac-16ab-46b1-9dde-b4b471ceeb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9683ac-16ab-46b1-9dde-b4b471ceeb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1182006800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851518de-50e7-4fdf-b9e6-341bab076ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:43Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d3313f-62de-44d4-8b55-32d7625ed1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d3313f-62de-44d4-8b55-32d7625ed1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c1d300-3622-4cc8-9fb3-e89a7c385dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c1d300-3622-4cc8-9fb3-e89a7c385dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '851518de-50e7-4fdf-b9e6-341bab076ba7', 'volume_name': 'volume-851518de-50e7-4fdf-b9e6-341bab076ba7', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:43 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696 Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cb9f45-e83a-4018-9756-fc2d065e6a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:43 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cb9f45-e83a-4018-9756-fc2d065e6a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb9c58f-8473-400a-88a4-680a964aa9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:43 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Volume 851518de-50e7-4fdf-b9e6-341bab076ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-851518de-50e7-4fdf-b9e6-341bab076ba7', 'volume_size': 1} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1182006800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851518de-50e7-4fdf-b9e6-341bab076ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:43Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Creating volume 851518de-50e7-4fdf-b9e6-341bab076ba7 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:09:43 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:43 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7 1073741824 Sep 17 17:09:43 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:43 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696" returned: 0 in 0.743s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:43 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696 Sep 17 17:09:43 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:44 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7 1073741824" returned: 0 in 0.885s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:44 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e61d5962-9a7b-4d7d-a5cc-2a54bf380696" returned: 0 in 0.435s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:44 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7 Sep 17 17:09:44 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Lock "cinder-quobyte-e61d5962-9a7b-4d7d-a5cc-2a54bf380696" released by "delete_volume" :: held 1.277s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Created reservations ['6d83a4ad-ec4b-49e3-858a-df365a5c9c89', 'e6097323-b808-4e14-a6c5-f985c0fbf988', '80cfc927-ce89-46b4-8abc-5541e8370a5d', '8a2053b1-a2cd-42bf-b53e-335616123445'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:44 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:09:44 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:44 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7" returned: 0 in 0.540s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb9c58f-8473-400a-88a4-680a964aa9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-851518de-50e7-4fdf-b9e6-341bab076ba7', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b558168-47a9-41db-b48b-cf48b742a90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:44 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.364s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:09:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Deleted volume successfully. Sep 17 17:09:44 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Volume volume-851518de-50e7-4fdf-b9e6-341bab076ba7 (851518de-50e7-4fdf-b9e6-341bab076ba7): created successfully Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b558168-47a9-41db-b48b-cf48b742a90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (e214e497-6715-4695-9455-92662e67a6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-84a512af-9864-49d7-b77b-afe42903fc62 tempest-VolumeQuotasAdminTestJSON-1171930846 None] Lock "cinder-e61d5962-9a7b-4d7d-a5cc-2a54bf380696-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-584992ec-d8a6-4939-92bf-02888e2a9b6b tempest-VolumesActionsTest-1762064101 None] Created volume successfully. Sep 17 17:09:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Acquiring lock "cinder-851518de-50e7-4fdf-b9e6-341bab076ba7-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Lock "cinder-851518de-50e7-4fdf-b9e6-341bab076ba7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Acquiring lock "cinder-quobyte-851518de-50e7-4fdf-b9e6-341bab076ba7" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Lock "cinder-quobyte-851518de-50e7-4fdf-b9e6-341bab076ba7" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:45 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4959625-d2cb-4ba8-b99d-3a4951ef68da]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:45 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7 Sep 17 17:09:45 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:46 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7" returned: 0 in 0.724s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:46 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7 Sep 17 17:09:46 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:46 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-851518de-50e7-4fdf-b9e6-341bab076ba7" returned: 0 in 0.360s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Lock "cinder-quobyte-851518de-50e7-4fdf-b9e6-341bab076ba7" released by "delete_volume" :: held 1.153s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Created reservations ['e35fd121-6686-442c-8224-0c2019634d94', '29633620-2e91-4cce-a96a-45380fa21fae', 'd4c77b64-6a60-41f4-9b5c-2d4cb95ff9c4', 'dfbc0549-34e2-409d-90f9-795f292e32fc'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:46 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:09:46 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:47 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.360s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:47 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:09:47 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Deleted volume successfully. Sep 17 17:09:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3ec9a6b4-ca6c-45e4-bad5-08728e79a841 tempest-VolumesActionsTest-182052595 None] Lock "cinder-851518de-50e7-4fdf-b9e6-341bab076ba7-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:48 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:09:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (2b1c1bcd-3d27-4eb3-adf2-2e6b26df511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5f0bb6-e0fe-41ba-be1d-4543b12b09e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5f0bb6-e0fe-41ba-be1d-4543b12b09e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493671425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffd68df-934a-4c31-845b-cfcb8dd49f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:49Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62953551-1d6c-4579-8fde-fd7c95b5715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62953551-1d6c-4579-8fde-fd7c95b5715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd4ffd1-7768-43ae-8b0f-7ed91997482b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd4ffd1-7768-43ae-8b0f-7ed91997482b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dffd68df-934a-4c31-845b-cfcb8dd49f69', 'volume_name': 'volume-dffd68df-934a-4c31-845b-cfcb8dd49f69', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249012e6-9528-4fd4-b578-6e33b73aeb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249012e6-9528-4fd4-b578-6e33b73aeb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1b5698-956d-4e50-b47f-a26e4da57e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:49 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Volume dffd68df-934a-4c31-845b-cfcb8dd49f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dffd68df-934a-4c31-845b-cfcb8dd49f69', 'volume_size': 1} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-493671425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffd68df-934a-4c31-845b-cfcb8dd49f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:49Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Creating volume dffd68df-934a-4c31-845b-cfcb8dd49f69 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:09:49 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:49 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69 1073741824 Sep 17 17:09:49 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:49 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69 1073741824" returned: 0 in 0.795s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:49 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69 Sep 17 17:09:49 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:50 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:09:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1b5698-956d-4e50-b47f-a26e4da57e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dffd68df-934a-4c31-845b-cfcb8dd49f69', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf0d062-c06b-44d3-9163-66a90d0d3dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:50 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Volume volume-dffd68df-934a-4c31-845b-cfcb8dd49f69 (dffd68df-934a-4c31-845b-cfcb8dd49f69): created successfully Sep 17 17:09:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf0d062-c06b-44d3-9163-66a90d0d3dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (2b1c1bcd-3d27-4eb3-adf2-2e6b26df511a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:50 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-45ce4f6d-c6f4-47c7-998c-0757be3d54fb tempest-VolumesActionsTest-1762064101 None] Created volume successfully. Sep 17 17:09:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Acquiring lock "cinder-dffd68df-934a-4c31-845b-cfcb8dd49f69-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Lock "cinder-dffd68df-934a-4c31-845b-cfcb8dd49f69-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Acquiring lock "cinder-quobyte-dffd68df-934a-4c31-845b-cfcb8dd49f69" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Lock "cinder-quobyte-dffd68df-934a-4c31-845b-cfcb8dd49f69" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c8a545-209d-419d-8e11-3423a5a37700]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:51 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69 Sep 17 17:09:51 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:51 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69" returned: 0 in 0.549s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:52 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69 Sep 17 17:09:52 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:52 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dffd68df-934a-4c31-845b-cfcb8dd49f69" returned: 0 in 0.499s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Lock "cinder-quobyte-dffd68df-934a-4c31-845b-cfcb8dd49f69" released by "delete_volume" :: held 1.142s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Created reservations ['d48a35d8-a8fb-4fcc-b532-00258a3738cd', 'a4a5eab7-adfa-4369-a154-29bf77f0358d', 'ba60a754-5e48-469a-affb-70eede77e15d', '81830da0-ef19-4c5d-aac6-5f62bdf082af'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:52 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:09:52 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:52 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.304s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:52 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:09:52 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Deleted volume successfully. Sep 17 17:09:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97b19ab2-502d-44d5-9b8f-ece334f8ea87 tempest-VolumesActionsTest-182052595 None] Lock "cinder-dffd68df-934a-4c31-845b-cfcb8dd49f69-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (7f716f4d-3416-4ff6-9f0b-e52d4cada930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a34cd2-b73c-44d5-8f18-0a8f057fa3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a34cd2-b73c-44d5-8f18-0a8f057fa3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-443883514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096dd9a5-5795-4b23-ab08-f87de1b96fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:54Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2eda99b-fdbc-46e8-8300-68f5a842573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2eda99b-fdbc-46e8-8300-68f5a842573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76c6eb3-e954-48b1-ab88-5a69e0cebd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76c6eb3-e954-48b1-ab88-5a69e0cebd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096dd9a5-5795-4b23-ab08-f87de1b96fbe', 'volume_name': 'volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25106698-0b9d-4eba-80d1-cae8efe947b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25106698-0b9d-4eba-80d1-cae8efe947b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32954267-cd88-4ae3-8d08-1017869143de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:54 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Volume 096dd9a5-5795-4b23-ab08-f87de1b96fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe', 'volume_size': 1} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-443883514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096dd9a5-5795-4b23-ab08-f87de1b96fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:54Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Creating volume 096dd9a5-5795-4b23-ab08-f87de1b96fbe {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:09:54 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:09:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:54 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe 1073741824 Sep 17 17:09:54 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:55 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe 1073741824" returned: 0 in 0.516s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:55 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe Sep 17 17:09:55 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:55 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe" returned: 0 in 0.348s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:09:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32954267-cd88-4ae3-8d08-1017869143de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4900f701-9201-4484-b846-652d61626690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:55 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Volume volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe (096dd9a5-5795-4b23-ab08-f87de1b96fbe): created successfully Sep 17 17:09:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4900f701-9201-4484-b846-652d61626690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (7f716f4d-3416-4ff6-9f0b-e52d4cada930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:55 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5b64aad0-1d81-4050-a73e-c23b73e756b2 tempest-VolumesActionsTest-1762064101 None] Created volume successfully. Sep 17 17:09:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Acquiring lock "cinder-096dd9a5-5795-4b23-ab08-f87de1b96fbe-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Lock "cinder-096dd9a5-5795-4b23-ab08-f87de1b96fbe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Acquiring lock "cinder-quobyte-096dd9a5-5795-4b23-ab08-f87de1b96fbe" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:09:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Lock "cinder-quobyte-096dd9a5-5795-4b23-ab08-f87de1b96fbe" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:09:56 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98a523d-bb68-4b70-83f4-0fe9e909c33a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:09:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:57 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe Sep 17 17:09:57 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:57 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe" returned: 0 in 0.429s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:57 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe Sep 17 17:09:57 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Flow 'volume_create_manager' (86bf4850-dc61-4405-859b-07912b569b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c5f107-cdd2-4e23-a67b-cb3bc05291b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c5f107-cdd2-4e23-a67b-cb3bc05291b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-513434891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a93e0d-c080-4c41-a6e8-0f05e7235cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583cc6d670d64085bc5d9d90470a41e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:57Z,use_quota=True,user_id='a266c7a9c40c4d4d8a6328d4b8fe264d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55005a4-fe41-453c-8016-6c19da470dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55005a4-fe41-453c-8016-6c19da470dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaabbd49-124e-4b66-b811-77c938609f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaabbd49-124e-4b66-b811-77c938609f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97a93e0d-c080-4c41-a6e8-0f05e7235cb1', 'volume_name': 'volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f700b93c-89f5-48b9-9b83-1d265180645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f700b93c-89f5-48b9-9b83-1d265180645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9f2904-55ca-4a01-8e10-70af86a6347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:57 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Volume 97a93e0d-c080-4c41-a6e8-0f05e7235cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1', 'volume_size': 1} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-513434891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a93e0d-c080-4c41-a6e8-0f05e7235cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583cc6d670d64085bc5d9d90470a41e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:57Z,use_quota=True,user_id='a266c7a9c40c4d4d8a6328d4b8fe264d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Creating volume 97a93e0d-c080-4c41-a6e8-0f05e7235cb1 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:09:57 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:57 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1 1073741824 Sep 17 17:09:57 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:57 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-096dd9a5-5795-4b23-ab08-f87de1b96fbe" returned: 0 in 0.292s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Lock "cinder-quobyte-096dd9a5-5795-4b23-ab08-f87de1b96fbe" released by "delete_volume" :: held 0.790s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Created reservations ['2e5ac417-b677-4341-a502-de8745e3b06e', '4b6ac2b6-919e-4d2c-8c98-e5af0b7a1da1', '812d687e-4127-4dcd-9dbe-408d39341a2c', '68f66149-0d15-4ca4-adc9-5744a782a002'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:57 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:09:57 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:58 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1 1073741824" returned: 0 in 0.584s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:58 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1 Sep 17 17:09:58 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:58 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.416s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:09:58 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Deleted volume successfully. Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8be7d92f-cb35-4985-ad1c-bd8de8d04860 tempest-VolumesActionsTest-182052595 None] Lock "cinder-096dd9a5-5795-4b23-ab08-f87de1b96fbe-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:09:58 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1" returned: 0 in 0.362s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9f2904-55ca-4a01-8e10-70af86a6347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f12aafc-775b-424a-8ecb-bc24b1abb3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:58 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Volume volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1 (97a93e0d-c080-4c41-a6e8-0f05e7235cb1): created successfully Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f12aafc-775b-424a-8ecb-bc24b1abb3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Flow 'volume_create_manager' (86bf4850-dc61-4405-859b-07912b569b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:58 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0d8b75c7-0b57-42b1-a78a-ce78b79880e6 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Created volume successfully. Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (315b5109-cc81-4866-9f19-0e1aea39c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2104b098-cf25-403a-ba14-1b8bcc3557f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2104b098-cf25-403a-ba14-1b8bcc3557f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1136451440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6442c3-08b7-4452-a928-7ba9a197359b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:59Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bf8687-6738-4d5d-92f5-18c4b87b5295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bf8687-6738-4d5d-92f5-18c4b87b5295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d0f5f7-b8bb-44d8-8a73-5583043ba5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d0f5f7-b8bb-44d8-8a73-5583043ba5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6442c3-08b7-4452-a928-7ba9a197359b', 'volume_name': 'volume-0e6442c3-08b7-4452-a928-7ba9a197359b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232e977e-f4ee-4524-a946-82393f630db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232e977e-f4ee-4524-a946-82393f630db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cabe7a-8e02-4438-9cf3-0788626257b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:09:58 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Volume 0e6442c3-08b7-4452-a928-7ba9a197359b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6442c3-08b7-4452-a928-7ba9a197359b', 'volume_size': 1} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1136451440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6442c3-08b7-4452-a928-7ba9a197359b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:09:59Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Creating volume 0e6442c3-08b7-4452-a928-7ba9a197359b {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:09:58 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:09:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:58 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b 1073741824 Sep 17 17:09:58 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:09:59 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Sep 17 17:09:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b 1073741824" returned: 0 in 0.879s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:09:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:09:59 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b Sep 17 17:09:59 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:00 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b" returned: 0 in 0.463s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:10:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cabe7a-8e02-4438-9cf3-0788626257b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6442c3-08b7-4452-a928-7ba9a197359b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e018402-0c8b-4257-846c-496fa7ae3820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:00 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Volume volume-0e6442c3-08b7-4452-a928-7ba9a197359b (0e6442c3-08b7-4452-a928-7ba9a197359b): created successfully Sep 17 17:10:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e018402-0c8b-4257-846c-496fa7ae3820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (315b5109-cc81-4866-9f19-0e1aea39c70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:00 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e13170f7-91ea-4277-962a-42d963d4f711 tempest-VolumesActionsTest-1762064101 None] Created volume successfully. Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Acquiring lock "cinder-97a93e0d-c080-4c41-a6e8-0f05e7235cb1-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Lock "cinder-97a93e0d-c080-4c41-a6e8-0f05e7235cb1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Acquiring lock "cinder-0e6442c3-08b7-4452-a928-7ba9a197359b-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Lock "cinder-0e6442c3-08b7-4452-a928-7ba9a197359b-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Acquiring lock "cinder-quobyte-97a93e0d-c080-4c41-a6e8-0f05e7235cb1" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Lock "cinder-quobyte-97a93e0d-c080-4c41-a6e8-0f05e7235cb1" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Acquiring lock "cinder-quobyte-0e6442c3-08b7-4452-a928-7ba9a197359b" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa5a52a-2972-4f99-8969-3abc638da8c8]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Lock "cinder-quobyte-0e6442c3-08b7-4452-a928-7ba9a197359b" acquired by "delete_volume" :: waited 0.053s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bb57d0-43bb-48be-ae52-24e210f19506]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:01 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1 Sep 17 17:10:01 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:01 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b Sep 17 17:10:01 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:01 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1" returned: 0 in 0.639s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:01 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1 Sep 17 17:10:01 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:02 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b" returned: 0 in 0.687s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:02 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b Sep 17 17:10:02 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:02 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-97a93e0d-c080-4c41-a6e8-0f05e7235cb1" returned: 0 in 0.415s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Lock "cinder-quobyte-97a93e0d-c080-4c41-a6e8-0f05e7235cb1" released by "delete_volume" :: held 1.138s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Created reservations ['50f4d334-3582-484c-88fe-2ef11f31107e', 'ad62e743-1db6-4f80-b580-af9f2ade00e5', 'bd877b9a-b260-4f68-867f-fafe90dc7f06', '44da2e88-0a97-48c0-8016-a10f8e8fa18a'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:02 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e6442c3-08b7-4452-a928-7ba9a197359b" returned: 0 in 0.538s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Lock "cinder-quobyte-0e6442c3-08b7-4452-a928-7ba9a197359b" released by "delete_volume" :: held 1.335s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:02 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:10:02 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Created reservations ['68b31175-fd3f-4b61-b4bb-26ae5442aeef', '551ac139-79c7-432a-a4b1-8fc5608d544f', '6408b24b-111f-41ef-960b-f572506b3a4b', '44029897-2abd-4f14-baf7-2f2529b3c240'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:02 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:10:02 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:03 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:03 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:10:03 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Deleted volume successfully. Sep 17 17:10:03 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.724s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:03 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:10:03 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Deleted volume successfully. Sep 17 17:10:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5acee76e-6727-4e10-99b1-4019dce51344 tempest-VolumesActionsTest-182052595 None] Lock "cinder-0e6442c3-08b7-4452-a928-7ba9a197359b-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd9f6b54-879f-46ca-a31b-1d7799d9f588 tempest-VolumeQuotasNegativeTestJSON-1533160151 None] Lock "cinder-97a93e0d-c080-4c41-a6e8-0f05e7235cb1-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (bc67130c-d690-41db-825b-d19414ee50aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ec6de9-7ef0-4caa-b863-998f4bfdeae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ec6de9-7ef0-4caa-b863-998f4bfdeae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1875918127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8da0ecd-5240-432e-8135-6319aac0828c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:05Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cbb4745-24e0-4b6f-9717-8498b930a0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cbb4745-24e0-4b6f-9717-8498b930a0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b66ab1f-2fc6-45a5-97b7-7c1ed337b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b66ab1f-2fc6-45a5-97b7-7c1ed337b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8da0ecd-5240-432e-8135-6319aac0828c', 'volume_name': 'volume-c8da0ecd-5240-432e-8135-6319aac0828c', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac34f8c4-c1f0-45d0-b09b-3aebc03299b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac34f8c4-c1f0-45d0-b09b-3aebc03299b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb274b4-f2d8-43e6-94dd-0b3d07b8d0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:04 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Volume c8da0ecd-5240-432e-8135-6319aac0828c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8da0ecd-5240-432e-8135-6319aac0828c', 'volume_size': 1} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1875918127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8da0ecd-5240-432e-8135-6319aac0828c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835a9574e391417aa44db71f86b8f789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:05Z,use_quota=True,user_id='3e1b5df7d39043369b9f0a95ef0274d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Creating volume c8da0ecd-5240-432e-8135-6319aac0828c {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:10:04 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:10:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:04 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c 1073741824 Sep 17 17:10:04 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:05 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c 1073741824" returned: 0 in 0.676s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:05 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c Sep 17 17:10:05 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:05 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c" returned: 0 in 0.315s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:10:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb274b4-f2d8-43e6-94dd-0b3d07b8d0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8da0ecd-5240-432e-8135-6319aac0828c', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abab375-34a0-414b-a699-7e0901022858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:05 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Volume volume-c8da0ecd-5240-432e-8135-6319aac0828c (c8da0ecd-5240-432e-8135-6319aac0828c): created successfully Sep 17 17:10:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abab375-34a0-414b-a699-7e0901022858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Flow 'volume_create_manager' (bc67130c-d690-41db-825b-d19414ee50aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:05 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-24829c60-33f7-4264-9ed6-d3ee4c4927fd tempest-VolumesActionsTest-1762064101 None] Created volume successfully. Sep 17 17:10:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Acquiring lock "cinder-c8da0ecd-5240-432e-8135-6319aac0828c-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Lock "cinder-c8da0ecd-5240-432e-8135-6319aac0828c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Acquiring lock "cinder-quobyte-c8da0ecd-5240-432e-8135-6319aac0828c" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Lock "cinder-quobyte-c8da0ecd-5240-432e-8135-6319aac0828c" acquired by "delete_volume" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:07 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f18296-9ffd-4ae1-b74b-2d2401817070]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:07 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c Sep 17 17:10:07 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:07 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c" returned: 0 in 0.400s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:07 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c Sep 17 17:10:07 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:08 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c8da0ecd-5240-432e-8135-6319aac0828c" returned: 0 in 0.280s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Lock "cinder-quobyte-c8da0ecd-5240-432e-8135-6319aac0828c" released by "delete_volume" :: held 0.738s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Created reservations ['4556d3cf-5cb2-46d0-946e-602512a9078a', 'a99c7fc5-c896-4d1e-a0a2-5df651d7a023', '07343805-2cce-4090-83e1-3ddff8a479e7', '52861a69-80bc-4b1b-9163-7144a480c497'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:08 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:10:08 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:08 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.278s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:10:08 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Deleted volume successfully. Sep 17 17:10:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3a09253-e2bc-4315-99b6-e0e3ed0cb56d tempest-VolumesActionsTest-1762064101 None] Lock "cinder-c8da0ecd-5240-432e-8135-6319aac0828c-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-034902e4-d5e3-4514-8c34-b9d163532ba7 req-353323a0-17ee-4c25-ba69-951c33a32e28 tempest-TestStampPattern-1882177794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-034902e4-d5e3-4514-8c34-b9d163532ba7 req-353323a0-17ee-4c25-ba69-951c33a32e28 tempest-TestStampPattern-1882177794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-034902e4-d5e3-4514-8c34-b9d163532ba7 req-353323a0-17ee-4c25-ba69-951c33a32e28 tempest-TestStampPattern-1882177794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-034902e4-d5e3-4514-8c34-b9d163532ba7 req-353323a0-17ee-4c25-ba69-951c33a32e28 tempest-TestStampPattern-1882177794 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-5c310164-5350-46f9-b22b-137bfb6b1326', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1be0fff7-21bf-4039-a633-4e216c798a9c', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:10:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-034902e4-d5e3-4514-8c34-b9d163532ba7 req-353323a0-17ee-4c25-ba69-951c33a32e28 tempest-TestStampPattern-1882177794 None] attachment_update completed successfully. Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Flow 'volume_create_manager' (fed3681d-ce4a-4350-8d28-071670911b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a441a89c-bf2a-4cd1-a734-98d3e6ee82c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a441a89c-bf2a-4cd1-a734-98d3e6ee82c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-521570667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e863e30-bfbb-46ef-9cc6-905b734036fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191d0351655c404c8516cbc85027c90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:12Z,use_quota=True,user_id='f597ffcb9b92438a8372b1ee4b0930bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c1fe314-1363-489c-b09d-f82120d2a4b1),volume_type_id=1c1fe314-1363-489c-b09d-f82120d2a4b1)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ac2a62-a0e9-4e44-9b41-f1ae7e58187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ac2a62-a0e9-4e44-9b41-f1ae7e58187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43352bd1-bbb3-46a4-9d0a-ddfd4ef3ef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43352bd1-bbb3-46a4-9d0a-ddfd4ef3ef56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e863e30-bfbb-46ef-9cc6-905b734036fe', 'volume_name': 'volume-1e863e30-bfbb-46ef-9cc6-905b734036fe', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05892b76-f8cc-4a47-b157-aa63153e7add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05892b76-f8cc-4a47-b157-aa63153e7add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f54f17-2b53-467a-a454-5a0d60ac3acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:12 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Volume 1e863e30-bfbb-46ef-9cc6-905b734036fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e863e30-bfbb-46ef-9cc6-905b734036fe', 'volume_size': 1} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-521570667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e863e30-bfbb-46ef-9cc6-905b734036fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='191d0351655c404c8516cbc85027c90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:12Z,use_quota=True,user_id='f597ffcb9b92438a8372b1ee4b0930bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c1fe314-1363-489c-b09d-f82120d2a4b1),volume_type_id=1c1fe314-1363-489c-b09d-f82120d2a4b1)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Creating volume 1e863e30-bfbb-46ef-9cc6-905b734036fe {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:10:12 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:12 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe 1073741824 Sep 17 17:10:12 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:12 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe 1073741824" returned: 0 in 0.476s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:12 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe Sep 17 17:10:12 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:13 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe" returned: 0 in 0.356s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:10:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f54f17-2b53-467a-a454-5a0d60ac3acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e863e30-bfbb-46ef-9cc6-905b734036fe', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f039a6b8-dd64-45e1-8f77-fe834296fafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:13 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Volume volume-1e863e30-bfbb-46ef-9cc6-905b734036fe (1e863e30-bfbb-46ef-9cc6-905b734036fe): created successfully Sep 17 17:10:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f039a6b8-dd64-45e1-8f77-fe834296fafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Flow 'volume_create_manager' (fed3681d-ce4a-4350-8d28-071670911b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7708c7f2-ecfb-42a3-9338-ea8b78bdccce tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Created volume successfully. Sep 17 17:10:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a71b92f0-305d-40d9-a617-693e7f810a63 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a71b92f0-305d-40d9-a617-693e7f810a63 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a71b92f0-305d-40d9-a617-693e7f810a63 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a71b92f0-305d-40d9-a617-693e7f810a63 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a71b92f0-305d-40d9-a617-693e7f810a63 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a71b92f0-305d-40d9-a617-693e7f810a63 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:15 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:10:15 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:15 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a71b92f0-305d-40d9-a617-693e7f810a63 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.361s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:15 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-a71b92f0-305d-40d9-a617-693e7f810a63 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:10:15 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a71b92f0-305d-40d9-a617-693e7f810a63 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Retype volume completed successfully. Sep 17 17:10:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Acquiring lock "cinder-1e863e30-bfbb-46ef-9cc6-905b734036fe-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "cinder-1e863e30-bfbb-46ef-9cc6-905b734036fe-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Acquiring lock "cinder-quobyte-1e863e30-bfbb-46ef-9cc6-905b734036fe" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "cinder-quobyte-1e863e30-bfbb-46ef-9cc6-905b734036fe" acquired by "delete_volume" :: waited 0.038s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:16 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4a3aaa-6963-44b1-bbd9-216f59440acc]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-e8612173-87c4-4aaf-b747-a830cff22723 req-36f724cb-882e-410e-9237-f71071d27878 tempest-TestStampPattern-1882177794 None] Terminate volume connection completed successfully. Sep 17 17:10:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-e8612173-87c4-4aaf-b747-a830cff22723 req-36f724cb-882e-410e-9237-f71071d27878 tempest-TestStampPattern-1882177794 None] Deleting attachment 1be0fff7-21bf-4039-a633-4e216c798a9c. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:10:16 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe Sep 17 17:10:16 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:17 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe" returned: 0 in 0.544s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:17 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe Sep 17 17:10:17 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Creating offline snapshot 26fe5b75-582f-4793-b7c5-9464a707025f of volume 5c310164-5350-46f9-b22b-137bfb6b1326 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:10:17 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1e863e30-bfbb-46ef-9cc6-905b734036fe" returned: 0 in 0.417s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a388d367-7460-4892-a366-99eb48ace34a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "cinder-quobyte-1e863e30-bfbb-46ef-9cc6-905b734036fe" released by "delete_volume" :: held 1.062s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:17 devstack cinder-volume[85889]: WARNING cinder.quota [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:10:17 devstack cinder-volume[85889]: WARNING cinder.quota [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Created reservations ['a8d53804-c51f-46fe-b3b8-dcdd4b695a52', 'c78dbea3-a5b5-4a01-86e8-395812a2792f', '5387e643-032d-4f75-9df6-e44238c88cdd', 'b793975f-05a4-4e87-ae5d-cc6bdfeacdbe'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:17 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 Sep 17 17:10:17 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:17 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:10:17 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:18 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.302s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:18 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:10:18 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Deleted volume successfully. Sep 17 17:10:18 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326" returned: 0 in 0.529s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1dd5b272-1d6f-4d6d-b5a0-ef011b690185 tempest-VolumeRetypeWithoutMigrationTest-1023883402 None] Lock "cinder-1e863e30-bfbb-46ef-9cc6-905b734036fe-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:18 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f 1G Sep 17 17:10:18 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:18 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f 1G" returned: 0 in 0.444s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c310164-5350-46f9-b22b-137bfb6b1326 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:18 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c310164-5350-46f9-b22b-137bfb6b1326 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f Sep 17 17:10:18 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:19 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c310164-5350-46f9-b22b-137bfb6b1326 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f" returned: 0 in 0.426s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:19 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f is being set with open permissions: ugo+rw Sep 17 17:10:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:19 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f Sep 17 17:10:19 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:19 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f" returned: 0 in 0.274s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:19 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.info Sep 17 17:10:19 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:19 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.info" returned: 0 in 0.311s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:19 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.info is being set with open permissions: ugo+rw Sep 17 17:10:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:19 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.info Sep 17 17:10:19 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:20 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.info" returned: 0 in 0.287s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:20 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-fcb3e8e9-e452-42b5-8b54-d185e6953267 tempest-TestStampPattern-1882177794 None] Create snapshot completed successfully Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:22 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:10:22 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:22 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.376s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:10:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Flow 'volume_create_manager' (96e46b0d-4d16-4bc6-a6c8-5ad5db18b624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9818eeb5-0d38-41c9-b850-db29fe6f19b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9818eeb5-0d38-41c9-b850-db29fe6f19b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1033739908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7f66ea-b20b-457e-b134-6afe59bcb524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588677e5076344ce83140e3c774599b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:26Z,use_quota=True,user_id='07e73709775245b8a22862b9e2689320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5abca0c-c6f3-45dd-ae58-bbd35cf12cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5abca0c-c6f3-45dd-ae58-bbd35cf12cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6824d2fa-59e0-43be-bac5-610039a55e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6824d2fa-59e0-43be-bac5-610039a55e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7f66ea-b20b-457e-b134-6afe59bcb524', 'volume_name': 'volume-6d7f66ea-b20b-457e-b134-6afe59bcb524', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea73187-db00-47b4-906e-ad7823857542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea73187-db00-47b4-906e-ad7823857542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c33ea78-ad5f-4548-a5e4-34d393e1e8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:26 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Volume 6d7f66ea-b20b-457e-b134-6afe59bcb524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7f66ea-b20b-457e-b134-6afe59bcb524', 'volume_size': 1} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1033739908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7f66ea-b20b-457e-b134-6afe59bcb524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588677e5076344ce83140e3c774599b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:26Z,use_quota=True,user_id='07e73709775245b8a22862b9e2689320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Creating volume 6d7f66ea-b20b-457e-b134-6afe59bcb524 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:10:26 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:26 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524 1073741824 Sep 17 17:10:26 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:26 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524 1073741824" returned: 0 in 0.600s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:26 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524 Sep 17 17:10:26 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:27 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524" returned: 0 in 0.330s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:10:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c33ea78-ad5f-4548-a5e4-34d393e1e8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7f66ea-b20b-457e-b134-6afe59bcb524', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5cb1bd-7d53-417a-98dd-ca96d307269a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:27 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Volume volume-6d7f66ea-b20b-457e-b134-6afe59bcb524 (6d7f66ea-b20b-457e-b134-6afe59bcb524): created successfully Sep 17 17:10:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5cb1bd-7d53-417a-98dd-ca96d307269a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Flow 'volume_create_manager' (96e46b0d-4d16-4bc6-a6c8-5ad5db18b624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:27 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b03966f2-90cb-48a5-85bd-1fa84f6df860 tempest-AbsoluteLimitsTests-985841522 None] Created volume successfully. Sep 17 17:10:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Acquiring lock "cinder-6d7f66ea-b20b-457e-b134-6afe59bcb524-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Lock "cinder-6d7f66ea-b20b-457e-b134-6afe59bcb524-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Acquiring lock "cinder-quobyte-6d7f66ea-b20b-457e-b134-6afe59bcb524" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Lock "cinder-quobyte-6d7f66ea-b20b-457e-b134-6afe59bcb524" acquired by "delete_volume" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:28 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a094de2-3c6b-4df8-98b4-f9822f35e706]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:28 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524 Sep 17 17:10:28 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:29 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524" returned: 0 in 0.464s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:29 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524 Sep 17 17:10:29 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=101,cinder:UPDATE=129,cinder:DELETE=15,cinder:INSERT=26 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=101,cinder:UPDATE=126,cinder:INSERT=29,cinder:DELETE=8 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Flow 'volume_create_manager' (74fe1055-1a41-499c-9d74-cbeb6c8e5746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f97de2-5e39-4936-9020-183b0dc49c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f97de2-5e39-4936-9020-183b0dc49c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2103140131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527760d0-a0bf-4ba0-8b54-3de28ea244f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3386a7019d704b8087e9c5f89932ec24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=26fe5b75-582f-4793-b7c5-9464a707025f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:29Z,use_quota=True,user_id='8d91c3404c4749648aa7346c6a63ce3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d1b52f-4df2-42fa-8cdd-8a1fe5c77ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:29 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d1b52f-4df2-42fa-8cdd-8a1fe5c77ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a1d0f9-9912-470b-af51-f1103731a11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a1d0f9-9912-470b-af51-f1103731a11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '527760d0-a0bf-4ba0-8b54-3de28ea244f1', 'volume_name': 'volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1', 'volume_size': 1, 'snapshot_id': '26fe5b75-582f-4793-b7c5-9464a707025f'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22ca4a4-0974-4f6e-8aa2-487e7a81d6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22ca4a4-0974-4f6e-8aa2-487e7a81d6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1aba553-dbd5-4fef-b858-9ea64e4f146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:29 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Volume 527760d0-a0bf-4ba0-8b54-3de28ea244f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1', 'volume_size': 1, 'snapshot_id': '26fe5b75-582f-4793-b7c5-9464a707025f'} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d7f66ea-b20b-457e-b134-6afe59bcb524" returned: 0 in 0.383s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Lock "cinder-quobyte-6d7f66ea-b20b-457e-b134-6afe59bcb524" released by "delete_volume" :: held 0.907s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Acquiring lock "cinder-quobyte-26fe5b75-582f-4793-b7c5-9464a707025f-527760d0-a0bf-4ba0-8b54-3de28ea244f1" by "_create_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-26fe5b75-582f-4793-b7c5-9464a707025f-527760d0-a0bf-4ba0-8b54-3de28ea244f1" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Creating volume 527760d0-a0bf-4ba0-8b54-3de28ea244f1 from snapshot 26fe5b75-582f-4793-b7c5-9464a707025f {{(pid=85889) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Acquiring lock "cinder-quobyte-527760d0-a0bf-4ba0-8b54-3de28ea244f1" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-527760d0-a0bf-4ba0-8b54-3de28ea244f1" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] snapshot: 26fe5b75-582f-4793-b7c5-9464a707025f, volume: 527760d0-a0bf-4ba0-8b54-3de28ea244f1, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Created reservations ['3465bdaa-d1f9-4ebf-bc83-f1e7c15e15c3', '0cc00d4d-bb7d-487a-8daf-9d6bc3f61b1f', '56b01a6a-a788-4b7d-bfab-7a5daeae075b', '37149f37-d07c-416f-9710-ed7e4094bceb'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff568b2-8a47-4158-b7ac-cb8acececa6a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:29 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:10:29 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:29 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f Sep 17 17:10:29 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:30 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.336s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:10:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Deleted volume successfully. Sep 17 17:10:30 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0000858b-00cc-4ca8-bd02-fa9dde910d47 tempest-AbsoluteLimitsTests-985841522 None] Lock "cinder-6d7f66ea-b20b-457e-b134-6afe59bcb524-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f" returned: 0 in 0.491s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c310164-5350-46f9-b22b-137bfb6b1326(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[634850df-4426-45a5-9052-c48adada4f82]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:30 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 Sep 17 17:10:30 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:30 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326" returned: 0 in 0.441s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:10:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:30 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 Sep 17 17:10:30 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:39 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:10:40 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:10:42 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1" returned: 0 in 11.464s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326, size 1024.00 MB, duration 11.47 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:10:42 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Converted 1024.00 MB image at 89.31 MB/s Sep 17 17:10:42 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 is being set with open permissions: ugo+rw Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:42 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 Sep 17 17:10:42 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:10:42 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Flow 'volume_create_manager' (eb5d1380-8cfc-45b5-b973-b2a1169b4a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c11ed-e4eb-480d-b072-ec39d0b9d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1" returned: 0 in 0.558s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c11ed-e4eb-480d-b072-ec39d0b9d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2035640590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b412a3c-d328-4c64-9306-4e72c38ff0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ae5a7542324dce86e00fabd57b07a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:42Z,use_quota=True,user_id='02e99ed71a5046d39e0a3ff10ac1769e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58f342f-8ac7-4b06-9e58-dfcd689fb046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58f342f-8ac7-4b06-9e58-dfcd689fb046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502ac016-3025-4a26-b3a8-93c0d20eec46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502ac016-3025-4a26-b3a8-93c0d20eec46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b412a3c-d328-4c64-9306-4e72c38ff0ff', 'volume_name': 'volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f32fbc-8a27-4fa2-9eed-fdbf422fb125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f32fbc-8a27-4fa2-9eed-fdbf422fb125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68750fd3-753a-4304-a228-cc4def1eddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:42 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Volume 4b412a3c-d328-4c64-9306-4e72c38ff0ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff', 'volume_size': 1} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-527760d0-a0bf-4ba0-8b54-3de28ea244f1" released by "_copy_volume_from_snapshot" :: held 13.210s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-26fe5b75-582f-4793-b7c5-9464a707025f-527760d0-a0bf-4ba0-8b54-3de28ea244f1" released by "_create_volume_from_snapshot" :: held 13.310s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.339s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2035640590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b412a3c-d328-4c64-9306-4e72c38ff0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ae5a7542324dce86e00fabd57b07a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:42Z,use_quota=True,user_id='02e99ed71a5046d39e0a3ff10ac1769e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Creating volume 4b412a3c-d328-4c64-9306-4e72c38ff0ff {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:10:42 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:10:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:43 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff 1073741824 Sep 17 17:10:43 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1aba553-dbd5-4fef-b858-9ea64e4f146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1', 'volume_size': 1, 'snapshot_id': '26fe5b75-582f-4793-b7c5-9464a707025f'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e5201d-cdc0-4130-8a27-4cca64560662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:43 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Volume volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 (527760d0-a0bf-4ba0-8b54-3de28ea244f1): created successfully Sep 17 17:10:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e5201d-cdc0-4130-8a27-4cca64560662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Flow 'volume_create_manager' (74fe1055-1a41-499c-9d74-cbeb6c8e5746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:43 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d3b2f4aa-3bec-462b-ad4e-86659739a0f1 tempest-TestStampPattern-1882177794 None] Created volume successfully. Sep 17 17:10:43 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff 1073741824" returned: 0 in 0.926s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:43 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff Sep 17 17:10:43 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:44 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff" returned: 0 in 0.434s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68750fd3-753a-4304-a228-cc4def1eddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de626603-b9a1-4d20-b4f1-c4e35978cbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:44 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Volume volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff (4b412a3c-d328-4c64-9306-4e72c38ff0ff): created successfully Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de626603-b9a1-4d20-b4f1-c4e35978cbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Flow 'volume_create_manager' (eb5d1380-8cfc-45b5-b973-b2a1169b4a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ba17a87b-9993-4b52-89c3-00bd34cd955e tempest-AttachVolumeTestJSON-117987046 None] Created volume successfully. Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Flow 'volume_create_manager' (6b4fba15-563b-4b76-99fb-3c92f2342634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624298fa-b8ca-4c8d-9375-369181bd0672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624298fa-b8ca-4c8d-9375-369181bd0672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2099063614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66522f20-2ddf-414a-b3d7-b94cfe7c7e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4ff8f3d18d4868883d6c1264fed15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:45Z,use_quota=True,user_id='0eed38f435444c0d88e4b2295a329523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e972860-96a2-4662-aff9-db85234b2fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e972860-96a2-4662-aff9-db85234b2fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57225130-116e-4f00-993b-ec112ace61b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57225130-116e-4f00-993b-ec112ace61b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66522f20-2ddf-414a-b3d7-b94cfe7c7e1c', 'volume_name': 'volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613f3c3f-cfb2-40fd-a282-934b67ad860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613f3c3f-cfb2-40fd-a282-934b67ad860d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878766d9-0147-4484-91ef-a77ac0921679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:44 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Volume 66522f20-2ddf-414a-b3d7-b94cfe7c7e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c', 'volume_size': 1} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2099063614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66522f20-2ddf-414a-b3d7-b94cfe7c7e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4ff8f3d18d4868883d6c1264fed15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:45Z,use_quota=True,user_id='0eed38f435444c0d88e4b2295a329523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Creating volume 66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:10:44 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:10:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:44 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c 1073741824 Sep 17 17:10:44 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:45 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c 1073741824" returned: 0 in 0.836s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:45 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c Sep 17 17:10:45 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-97e8d233-0536-458c-a257-3bbaedb6def7 req-f4f26340-5bac-4571-9bb7-02bc1ce379f8 tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:46 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" returned: 0 in 0.458s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-97e8d233-0536-458c-a257-3bbaedb6def7 req-f4f26340-5bac-4571-9bb7-02bc1ce379f8 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.111s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878766d9-0147-4484-91ef-a77ac0921679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7359e686-6df6-4d2a-8c76-b1f4d936e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-97e8d233-0536-458c-a257-3bbaedb6def7 req-f4f26340-5bac-4571-9bb7-02bc1ce379f8 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:46 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Volume volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c (66522f20-2ddf-414a-b3d7-b94cfe7c7e1c): created successfully Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7359e686-6df6-4d2a-8c76-b1f4d936e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Flow 'volume_create_manager' (6b4fba15-563b-4b76-99fb-3c92f2342634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0ccb4b79-f93f-4d7b-ab7e-260d1dc5ed0e tempest-VolumesDeleteCascade-2051976207 None] Created volume successfully. Sep 17 17:10:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-97e8d233-0536-458c-a257-3bbaedb6def7 req-f4f26340-5bac-4571-9bb7-02bc1ce379f8 tempest-AttachVolumeTestJSON-117987046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58a8a726-caf1-4c5a-9492-72b4cb957ef0', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:10:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-97e8d233-0536-458c-a257-3bbaedb6def7 req-f4f26340-5bac-4571-9bb7-02bc1ce379f8 tempest-AttachVolumeTestJSON-117987046 None] attachment_update completed successfully. Sep 17 17:10:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Creating offline snapshot 49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 of volume 66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:10:47 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e90e229-bd62-4641-89e8-e90dd7a04e42]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:47 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c Sep 17 17:10:47 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:47 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" returned: 0 in 0.585s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:47 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 1G Sep 17 17:10:47 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:48 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 1G" returned: 0 in 0.968s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:48 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 Sep 17 17:10:48 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:49 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6" returned: 0 in 0.509s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:49 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 is being set with open permissions: ugo+rw Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:49 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 Sep 17 17:10:49 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:49 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6" returned: 0 in 0.284s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:49 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.info Sep 17 17:10:49 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:49 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Flow 'volume_create_manager' (24070997-ea74-4614-9ec0-e65d9a332daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d703caf-3b03-47a0-95c4-d64d5d95cadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.info" returned: 0 in 0.363s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:49 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.info is being set with open permissions: ugo+rw Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d703caf-3b03-47a0-95c4-d64d5d95cadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1035461199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a09ac7-97c8-4c73-9c83-12c4832e0c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847a630b9bbf45ff8017425a56391192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:50Z,use_quota=True,user_id='fee6e5f78a444017a51b97f4527090ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:49 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.info Sep 17 17:10:49 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91f1cfd-c3ed-4749-9406-70c38a38149a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91f1cfd-c3ed-4749-9406-70c38a38149a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18412bf-9b00-4fe6-9f64-d0ac4815ff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18412bf-9b00-4fe6-9f64-d0ac4815ff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a09ac7-97c8-4c73-9c83-12c4832e0c05', 'volume_name': 'volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d018decb-9e86-47bf-ae0b-631f19350a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d018decb-9e86-47bf-ae0b-631f19350a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ef7010-a964-4456-b7e1-4c3d246e82ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:49 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Volume b7a09ac7-97c8-4c73-9c83-12c4832e0c05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05', 'volume_size': 1} Sep 17 17:10:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:50 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.info" returned: 0 in 0.286s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.241s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1035461199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a09ac7-97c8-4c73-9c83-12c4832e0c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847a630b9bbf45ff8017425a56391192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:50Z,use_quota=True,user_id='fee6e5f78a444017a51b97f4527090ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Creating volume b7a09ac7-97c8-4c73-9c83-12c4832e0c05 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:10:50 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:50 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05 1073741824 Sep 17 17:10:50 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:50 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1f6891c7-03d2-4174-a6a7-b1afaccef85a tempest-VolumesDeleteCascade-2051976207 None] Create snapshot completed successfully Sep 17 17:10:50 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05 1073741824" returned: 0 in 0.510s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:50 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05 Sep 17 17:10:50 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:50 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:10:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ef7010-a964-4456-b7e1-4c3d246e82ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6094c891-fdd1-457e-9ac9-81b0a2715c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:51 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Volume volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05 (b7a09ac7-97c8-4c73-9c83-12c4832e0c05): created successfully Sep 17 17:10:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6094c891-fdd1-457e-9ac9-81b0a2715c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Flow 'volume_create_manager' (24070997-ea74-4614-9ec0-e65d9a332daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6e83a438-f891-4fa7-8ae0-0da7676892c3 tempest-VolumesListAdminTestJSON-2099232146 None] Created volume successfully. Sep 17 17:10:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] Creating offline snapshot b5bd3a7f-cc8b-464c-8ffd-086d702815aa of volume 66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:10:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd9034b-72aa-4881-b4fc-718f3f558df1]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:52 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 Sep 17 17:10:52 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:52 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6" returned: 0 in 0.683s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:10:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:52 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa 1G Sep 17 17:10:52 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:52 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:10:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Flow 'volume_create_manager' (1a4100a0-5017-4758-a806-f0e9657fd200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8aeec3f-ae15-4c12-8cd2-364c35a9547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8aeec3f-ae15-4c12-8cd2-364c35a9547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-333635978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489ec081-ebc4-41c4-88ce-d59b98248f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847a630b9bbf45ff8017425a56391192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:53Z,use_quota=True,user_id='fee6e5f78a444017a51b97f4527090ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6d0695-8508-4554-bb23-9be54e93df5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6d0695-8508-4554-bb23-9be54e93df5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28c2192-9870-4945-8ccf-1ec59891831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28c2192-9870-4945-8ccf-1ec59891831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489ec081-ebc4-41c4-88ce-d59b98248f8c', 'volume_name': 'volume-489ec081-ebc4-41c4-88ce-d59b98248f8c', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de6afd5-64de-48a7-a29b-c6c15d000b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de6afd5-64de-48a7-a29b-c6c15d000b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4500c60d-ee87-4b20-a94a-4a7b35695de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:53 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Volume 489ec081-ebc4-41c4-88ce-d59b98248f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489ec081-ebc4-41c4-88ce-d59b98248f8c', 'volume_size': 1} Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:53 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa 1G" returned: 0 in 0.731s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:53 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa Sep 17 17:10:53 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:53 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa" returned: 0 in 0.647s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:53 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa is being set with open permissions: ugo+rw Sep 17 17:10:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:53 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa Sep 17 17:10:53 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:54 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa" returned: 0 in 0.491s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.383s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-333635978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489ec081-ebc4-41c4-88ce-d59b98248f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847a630b9bbf45ff8017425a56391192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:53Z,use_quota=True,user_id='fee6e5f78a444017a51b97f4527090ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Creating volume 489ec081-ebc4-41c4-88ce-d59b98248f8c {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:10:54 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:54 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c 1073741824 Sep 17 17:10:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-dceb5995-a12f-4e5a-a625-238121c40fc0 tempest-VolumesDeleteCascade-2051976207 None] Create snapshot completed successfully Sep 17 17:10:54 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Performing cascade delete. {{(pid=85889) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 17:10:55 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c 1073741824" returned: 0 in 0.765s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" acquired by "delete_snapshot" :: waited 0.081s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:55 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c Sep 17 17:10:55 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Deleting offline snapshot 49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 of volume 66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] snapshot_file for this snap is: volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5fa440-a953-436a-9a91-c580f98d50bf]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:55 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 Sep 17 17:10:55 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:55 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c" returned: 0 in 0.535s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4500c60d-ee87-4b20-a94a-4a7b35695de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489ec081-ebc4-41c4-88ce-d59b98248f8c', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6701f528-d5cc-4360-aaae-09faf22ac51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:55 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Volume volume-489ec081-ebc4-41c4-88ce-d59b98248f8c (489ec081-ebc4-41c4-88ce-d59b98248f8c): created successfully Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6701f528-d5cc-4360-aaae-09faf22ac51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Flow 'volume_create_manager' (1a4100a0-5017-4758-a806-f0e9657fd200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:55 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7225438d-103c-4015-ac23-b85817dc196b tempest-VolumesListAdminTestJSON-2099232146 None] Created volume successfully. Sep 17 17:10:56 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6" returned: 0 in 0.433s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:10:56 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[88871686-4dda-4a6e-b75f-e69eb2460ae3]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:56 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c Sep 17 17:10:56 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:56 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" returned: 0 in 0.500s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:56 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c568809f-9235-4019-820c-50f4baef38e2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:56 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa Sep 17 17:10:56 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:56 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Flow 'volume_create_manager' (2405f71b-deb8-407a-a95b-52b2271aef5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf2b3ba-bddb-40ee-99b7-91a4b2bc181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf2b3ba-bddb-40ee-99b7-91a4b2bc181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1517328038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03596f7-37d1-4e8e-9b60-c94a1802edd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847a630b9bbf45ff8017425a56391192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:57Z,use_quota=True,user_id='fee6e5f78a444017a51b97f4527090ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929d1d9f-3401-49c9-abbf-a0e5ae41b1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929d1d9f-3401-49c9-abbf-a0e5ae41b1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2762bc6f-8eea-4998-8d24-4ba325022fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2762bc6f-8eea-4998-8d24-4ba325022fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03596f7-37d1-4e8e-9b60-c94a1802edd3', 'volume_name': 'volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47e2c8a-c31f-40af-b322-01d9fa488f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47e2c8a-c31f-40af-b322-01d9fa488f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb1bf7f-4763-43e5-892b-2ff8adf8b082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:57 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Volume c03596f7-37d1-4e8e-9b60-c94a1802edd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3', 'volume_size': 1} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1517328038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03596f7-37d1-4e8e-9b60-c94a1802edd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847a630b9bbf45ff8017425a56391192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:10:57Z,use_quota=True,user_id='fee6e5f78a444017a51b97f4527090ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Creating volume c03596f7-37d1-4e8e-9b60-c94a1802edd3 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:10:57 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:57 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3 1073741824 Sep 17 17:10:57 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:57 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa" returned: 0 in 0.503s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[de139f9e-87af-4959-9f7c-e7f1ae01b553]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:57 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 Sep 17 17:10:57 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:57 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3 1073741824" returned: 0 in 0.473s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:57 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6" returned: 0 in 0.421s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[123a67ca-3400-48ad-a994-9a2653e6d9c4]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:57 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3 Sep 17 17:10:57 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:57 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c Sep 17 17:10:57 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:57 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3" returned: 0 in 0.297s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb1bf7f-4763-43e5-892b-2ff8adf8b082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d932d540-783c-4603-b4fb-ef468f385924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:57 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Volume volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3 (c03596f7-37d1-4e8e-9b60-c94a1802edd3): created successfully Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d932d540-783c-4603-b4fb-ef468f385924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Flow 'volume_create_manager' (2405f71b-deb8-407a-a95b-52b2271aef5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:57 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e8b37878-b450-4e89-8be2-6d3696452b44 tempest-VolumesListAdminTestJSON-2099232146 None] Created volume successfully. Sep 17 17:10:57 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" returned: 0 in 0.399s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:58 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 Sep 17 17:10:58 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:58 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6" returned: 0 in 0.361s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:58 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6 Sep 17 17:10:58 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:58 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6" returned: 0 in 0.264s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa -F qcow2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:58 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa -F qcow2 Sep 17 17:10:58 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:58 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa -F qcow2" returned: 0 in 0.299s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:58 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6" released by "_delete_snapshot" :: held 3.498s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:58 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" released by "delete_snapshot" :: held 3.587s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Created reservations ['dd33d93c-4901-4521-96c2-fe59127df9f0', '506f7510-663c-4555-8895-78411d937901', '95d2fa1c-817b-49fa-a2fa-d0c94c5864e5', '13aa43cb-b1a2-4fd1-9e2e-04ac1a4b1567'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:10:59 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Delete snapshot completed successfully. Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-49b2a8c8-a5cd-49d7-ae8d-76241c9fb7a6-delete_snapshot" released by "delete_snapshot" :: held 3.865s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-b5bd3a7f-cc8b-464c-8ffd-086d702815aa-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-b5bd3a7f-cc8b-464c-8ffd-086d702815aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-b5bd3a7f-cc8b-464c-8ffd-086d702815aa" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-b5bd3a7f-cc8b-464c-8ffd-086d702815aa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Deleting offline snapshot b5bd3a7f-cc8b-464c-8ffd-086d702815aa of volume 66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] snapshot_file for this snap is: volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dca9220-3ec4-4b07-9aa7-f29da9ec03c6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:59 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa Sep 17 17:10:59 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:59 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa" returned: 0 in 0.395s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee3d5e2-e10a-44df-84b1-380a5b86b005]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:59 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c Sep 17 17:10:59 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Flow 'volume_create_manager' (2a641e24-077a-4cef-ac58-45e170e92797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b56db13-85ac-4483-99c9-5eb0c7e9be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b56db13-85ac-4483-99c9-5eb0c7e9be1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c78feec-35fc-4456-b8b3-85a8287f3da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e5b9170158498c8b55a39a41ddca68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:00Z,use_quota=True,user_id='3257e8ff3dbe411ea1deac330553dcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fc19d7-12ba-4983-9cee-963282e87c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fc19d7-12ba-4983-9cee-963282e87c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f41952-597b-4307-bcbf-8c9bb34e5466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f41952-597b-4307-bcbf-8c9bb34e5466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c78feec-35fc-4456-b8b3-85a8287f3da1', 'volume_name': 'volume-4c78feec-35fc-4456-b8b3-85a8287f3da1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4935f4d0-21e0-4682-a729-8b7a56957a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4935f4d0-21e0-4682-a729-8b7a56957a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ee3546-a702-450c-8858-24bd098a9cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:10:59 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Volume 4c78feec-35fc-4456-b8b3-85a8287f3da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c78feec-35fc-4456-b8b3-85a8287f3da1', 'volume_size': 1} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c78feec-35fc-4456-b8b3-85a8287f3da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e5b9170158498c8b55a39a41ddca68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:00Z,use_quota=True,user_id='3257e8ff3dbe411ea1deac330553dcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Creating volume 4c78feec-35fc-4456-b8b3-85a8287f3da1 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:10:59 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:10:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:10:59 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1 1073741824 Sep 17 17:10:59 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:00 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" returned: 0 in 0.387s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:00 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa Sep 17 17:11:00 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:00 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1 1073741824" returned: 0 in 0.474s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:00 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:00 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa Sep 17 17:11:00 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:00 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1 Sep 17 17:11:00 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:00 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c.b5bd3a7f-cc8b-464c-8ffd-086d702815aa" returned: 0 in 0.283s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:00 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1" returned: 0 in 0.312s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-b5bd3a7f-cc8b-464c-8ffd-086d702815aa" released by "_delete_snapshot" :: held 1.598s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" released by "delete_snapshot" :: held 1.626s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ee3546-a702-450c-8858-24bd098a9cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c78feec-35fc-4456-b8b3-85a8287f3da1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8835c63-377f-4801-9720-2445246efc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:00 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Volume volume-4c78feec-35fc-4456-b8b3-85a8287f3da1 (4c78feec-35fc-4456-b8b3-85a8287f3da1): created successfully Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8835c63-377f-4801-9720-2445246efc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Flow 'volume_create_manager' (2a641e24-077a-4cef-ac58-45e170e92797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:00 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0b936bca-3d6a-489e-857b-158a09b1c3c3 tempest-VolumesListAdminTestJSON-885251006 None] Created volume successfully. Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Created reservations ['7992fa68-f731-4417-9d1f-ecc80034a860', '183294e8-34ed-4146-8cd3-7e073aed0bfe', 'f4d8a1f9-180b-4bfd-99f1-693e653e546c', '62f3c0be-99b2-4b82-b791-bbe66732e9e9'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:00 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Delete snapshot completed successfully. Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-b5bd3a7f-cc8b-464c-8ffd-086d702815aa-delete_snapshot" released by "delete_snapshot" :: held 1.816s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Snapshots deleted, issuing volume delete {{(pid=85889) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9a1d10-00e0-4e87-83f3-e6d58d621672]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:01 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c Sep 17 17:11:01 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:01 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" returned: 0 in 0.385s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:01 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c Sep 17 17:11:01 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:01 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" returned: 0 in 0.279s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c" released by "delete_volume" :: held 0.739s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Created reservations ['1c20ffd1-c51e-4dfe-bd5d-e7e72d2487fe', '2bdcfc5f-27a9-4d84-9f0c-88560ad0ee07', 'dd22daf1-8354-4058-a220-f45216450be2', 'a96f26e8-319f-4780-9430-750fbfcc342f'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:01 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:01 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Acquiring lock "cinder-4c78feec-35fc-4456-b8b3-85a8287f3da1-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Lock "cinder-4c78feec-35fc-4456-b8b3-85a8287f3da1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Acquiring lock "cinder-quobyte-4c78feec-35fc-4456-b8b3-85a8287f3da1" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:02 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.338s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Lock "cinder-quobyte-4c78feec-35fc-4456-b8b3-85a8287f3da1" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Deleted volume successfully. Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[316bdd69-3bc4-45a8-9521-2cba90e5d323]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-841faf56-933b-4a9f-9b7e-d9174f59f250 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-66522f20-2ddf-414a-b3d7-b94cfe7c7e1c-delete_volume" released by "delete_volume" :: held 7.273s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "cinder-c03596f7-37d1-4e8e-9b60-c94a1802edd3-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-c03596f7-37d1-4e8e-9b60-c94a1802edd3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "cinder-quobyte-c03596f7-37d1-4e8e-9b60-c94a1802edd3" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-quobyte-c03596f7-37d1-4e8e-9b60-c94a1802edd3" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:02 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1 Sep 17 17:11:02 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0a4382-13ec-4d79-8240-61aa40b9252e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:02 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3 Sep 17 17:11:02 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:02 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1" returned: 0 in 0.448s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:02 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1 Sep 17 17:11:02 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:02 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3" returned: 0 in 0.463s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:02 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3 Sep 17 17:11:02 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:03 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c78feec-35fc-4456-b8b3-85a8287f3da1" returned: 0 in 0.380s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Lock "cinder-quobyte-4c78feec-35fc-4456-b8b3-85a8287f3da1" released by "delete_volume" :: held 0.918s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Created reservations ['b710c450-cf43-45d0-b68e-9cefdab1026f', '83eef7d2-1ced-4fb3-829c-06df31eeebd7', '0f1d82f8-34ed-4040-b91e-db149957a588', '820ed814-ddc9-480a-aa8c-0b57253d0e33'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:03 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c03596f7-37d1-4e8e-9b60-c94a1802edd3" returned: 0 in 0.466s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-quobyte-c03596f7-37d1-4e8e-9b60-c94a1802edd3" released by "delete_volume" :: held 1.082s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:03 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:03 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Created reservations ['8718b4f1-8c1c-4b38-9061-dd200e2d9e5e', 'fb292488-b67c-4f5a-85ae-818ff17029c6', 'ac48644c-19f6-45ed-817e-41a2041c6d6c', 'd7eaecfe-d5e6-4c7f-9bed-a7b367bb4e01'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:03 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:03 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:03 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.560s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:03 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:03 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Deleted volume successfully. Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5f3d92f2-33d6-4d94-a41c-348fea6c0fa6 tempest-VolumesListAdminTestJSON-885251006 None] Lock "cinder-4c78feec-35fc-4456-b8b3-85a8287f3da1-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:11:04 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Flow 'volume_create_manager' (01e0cc23-9a4f-491b-8984-fd4607db0db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5543b09-eb44-44d0-b89c-599f00187ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.446s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Deleted volume successfully. Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5543b09-eb44-44d0-b89c-599f00187ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-872225265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9795b6-3dbb-4cdc-8bce-b193f5a8a752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4ff8f3d18d4868883d6c1264fed15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:04Z,use_quota=True,user_id='0eed38f435444c0d88e4b2295a329523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f7c003-1450-4dcb-91aa-795d4018af68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f7c003-1450-4dcb-91aa-795d4018af68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e4d4a2-ed54-4107-9849-0400a4e31fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e4d4a2-ed54-4107-9849-0400a4e31fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9795b6-3dbb-4cdc-8bce-b193f5a8a752', 'volume_name': 'volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0444e3-6e11-423c-8cf2-00962867d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0444e3-6e11-423c-8cf2-00962867d967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfea368-84cf-4a29-b84a-97a51556c910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:04 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Volume 5a9795b6-3dbb-4cdc-8bce-b193f5a8a752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752', 'volume_size': 1} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-872225265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9795b6-3dbb-4cdc-8bce-b193f5a8a752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4ff8f3d18d4868883d6c1264fed15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:04Z,use_quota=True,user_id='0eed38f435444c0d88e4b2295a329523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Creating volume 5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:11:04 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:04 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 1073741824 Sep 17 17:11:04 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4373942c-a69e-41a9-9ed8-bd79fe351996 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-c03596f7-37d1-4e8e-9b60-c94a1802edd3-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "cinder-489ec081-ebc4-41c4-88ce-d59b98248f8c-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-489ec081-ebc4-41c4-88ce-d59b98248f8c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:04 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 1073741824" returned: 0 in 0.598s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "cinder-quobyte-489ec081-ebc4-41c4-88ce-d59b98248f8c" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-quobyte-489ec081-ebc4-41c4-88ce-d59b98248f8c" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec219d4f-c881-4254-b5f3-6422396ff632]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:04 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 Sep 17 17:11:04 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:05 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c Sep 17 17:11:05 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:05 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" returned: 0 in 0.350s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfea368-84cf-4a29-b84a-97a51556c910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10bf210-b625-4282-b116-14ed91463200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:05 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Volume volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 (5a9795b6-3dbb-4cdc-8bce-b193f5a8a752): created successfully Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10bf210-b625-4282-b116-14ed91463200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Flow 'volume_create_manager' (01e0cc23-9a4f-491b-8984-fd4607db0db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:05 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a62f72a6-a7e8-45ff-b03d-0da586e7aaec tempest-VolumesDeleteCascade-2051976207 None] Created volume successfully. Sep 17 17:11:05 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c" returned: 0 in 0.443s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:05 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c Sep 17 17:11:05 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:05 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-489ec081-ebc4-41c4-88ce-d59b98248f8c" returned: 0 in 0.248s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-quobyte-489ec081-ebc4-41c4-88ce-d59b98248f8c" released by "delete_volume" :: held 0.761s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Created reservations ['b63cfebd-df9f-4ab4-9d4f-d48ff611535d', '310cab88-a592-4b79-b922-aeeb15550fcd', '59fe29da-ec08-4bed-8afb-7c9d1364416c', 'fd71a62b-2551-408c-8334-95a2dc36996f'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:05 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:05 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:06 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "cinder-b7a09ac7-97c8-4c73-9c83-12c4832e0c05-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.297s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:06 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Deleted volume successfully. Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-b7a09ac7-97c8-4c73-9c83-12c4832e0c05-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-263cb414-163d-4947-b49c-135049ba6324 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-489ec081-ebc4-41c4-88ce-d59b98248f8c-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "cinder-quobyte-b7a09ac7-97c8-4c73-9c83-12c4832e0c05" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-quobyte-b7a09ac7-97c8-4c73-9c83-12c4832e0c05" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83256f5-09e6-4fdb-8022-1c7927b11469]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:06 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05 Sep 17 17:11:06 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Creating offline snapshot f4421fbd-4930-4186-9061-3ffa10665629 of volume 5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c766fb-7edb-4cff-8e9f-f2076606fc87]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:06 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 Sep 17 17:11:06 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:06 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05" returned: 0 in 0.433s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:06 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05 Sep 17 17:11:06 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:06 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" returned: 0 in 0.388s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:06 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 1G Sep 17 17:11:06 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:06 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b7a09ac7-97c8-4c73-9c83-12c4832e0c05" returned: 0 in 0.273s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-quobyte-b7a09ac7-97c8-4c73-9c83-12c4832e0c05" released by "delete_volume" :: held 0.763s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Created reservations ['432455a6-2a1e-4a7d-85ef-940d2ee9c6a3', 'e727c373-c4fe-48d8-9162-7a25877b136e', '7d25d6eb-efae-4336-8223-d43e17189491', 'e75ec945-8692-4630-b5a8-6a3ad7ee5664'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:07 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:07 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:07 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 1G" returned: 0 in 0.479s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:07 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 Sep 17 17:11:07 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:07 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.321s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Deleted volume successfully. Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1c14736e-87d8-4ec8-8e17-00d6ee70d941 tempest-VolumesListAdminTestJSON-2099232146 None] Lock "cinder-b7a09ac7-97c8-4c73-9c83-12c4832e0c05-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:07 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629" returned: 0 in 0.386s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:07 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 is being set with open permissions: ugo+rw Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:07 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 Sep 17 17:11:07 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:07 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629" returned: 0 in 0.298s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:08 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.info Sep 17 17:11:08 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:08 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.info" returned: 0 in 0.444s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:08 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.info is being set with open permissions: ugo+rw Sep 17 17:11:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:08 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.info Sep 17 17:11:08 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:08 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.info" returned: 0 in 0.353s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:08 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-19f191b3-6bd8-4fba-b327-9eca428668aa tempest-VolumesDeleteCascade-2051976207 None] Create snapshot completed successfully Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Flow 'volume_create_manager' (26116455-3b8d-490d-b140-0bbab95dce03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd1d01a-0bdd-4f54-9fc8-c53cbd721357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd1d01a-0bdd-4f54-9fc8-c53cbd721357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-601091502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f993d3aa-e0d3-4838-8d59-8794d24af0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4ff8f3d18d4868883d6c1264fed15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f4421fbd-4930-4186-9061-3ffa10665629,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:10Z,use_quota=True,user_id='0eed38f435444c0d88e4b2295a329523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6216d349-ef86-460e-8dc2-79fd8c2fe682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6216d349-ef86-460e-8dc2-79fd8c2fe682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9bdd86-8dba-4e0d-983d-2577e61bfac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9bdd86-8dba-4e0d-983d-2577e61bfac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f993d3aa-e0d3-4838-8d59-8794d24af0c6', 'volume_name': 'volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6', 'volume_size': 1, 'snapshot_id': 'f4421fbd-4930-4186-9061-3ffa10665629'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c5ac1e-bf27-4519-bc57-de4e5c49a2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c5ac1e-bf27-4519-bc57-de4e5c49a2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f287e91-d92d-473b-8e27-6f48c149bb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:10 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Volume f993d3aa-e0d3-4838-8d59-8794d24af0c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6', 'volume_size': 1, 'snapshot_id': 'f4421fbd-4930-4186-9061-3ffa10665629'} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-f4421fbd-4930-4186-9061-3ffa10665629-f993d3aa-e0d3-4838-8d59-8794d24af0c6" by "_create_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-f4421fbd-4930-4186-9061-3ffa10665629-f993d3aa-e0d3-4838-8d59-8794d24af0c6" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Creating volume f993d3aa-e0d3-4838-8d59-8794d24af0c6 from snapshot f4421fbd-4930-4186-9061-3ffa10665629 {{(pid=85889) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-f993d3aa-e0d3-4838-8d59-8794d24af0c6" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-f993d3aa-e0d3-4838-8d59-8794d24af0c6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] snapshot: f4421fbd-4930-4186-9061-3ffa10665629, volume: f993d3aa-e0d3-4838-8d59-8794d24af0c6, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1171596-f034-49af-8b38-1f4d5e5f1d37]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:10 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 Sep 17 17:11:10 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:10 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629" returned: 0 in 0.398s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecb9b01-1962-4482-b1c4-c83f1ade7fa9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:10 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 Sep 17 17:11:10 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:11 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" returned: 0 in 0.435s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:11:11 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:11:11 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:11:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:11 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 Sep 17 17:11:11 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-d0019dd5-f763-446d-a4b1-703c607a865e req-beb1f3e3-3292-4e87-ae0b-57db6bd03ba0 tempest-TestStampPattern-1882177794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Flow 'volume_create_manager' (0b0da4a2-e538-40e4-8997-155612418235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4f118f-82d4-48ff-947c-e40983e32e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4f118f-82d4-48ff-947c-e40983e32e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1156027728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272ead5c-33dd-46e4-a220-d4ed23e7ddc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c28a1627a264d9c8a9f9c2b46bf4a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:19Z,use_quota=True,user_id='941b7b42a67745d981d69034573daac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e04513-7920-4cb2-849e-ccf5383a695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e04513-7920-4cb2-849e-ccf5383a695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8628f00a-9e3d-438c-8d76-6791b0b5435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8628f00a-9e3d-438c-8d76-6791b0b5435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272ead5c-33dd-46e4-a220-d4ed23e7ddc4', 'volume_name': 'volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6af2c22-4fd4-40fc-badd-38a9374a4231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6af2c22-4fd4-40fc-badd-38a9374a4231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4f0936-9ff9-43b8-9eaa-1484f015b717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:18 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Volume 272ead5c-33dd-46e4-a220-d4ed23e7ddc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4', 'volume_size': 1} Sep 17 17:11:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:19 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6" returned: 0 in 8.049s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752, size 1024.00 MB, duration 8.05 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:11:19 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Converted 1024.00 MB image at 127.20 MB/s Sep 17 17:11:19 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 is being set with open permissions: ugo+rw Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:19 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 Sep 17 17:11:19 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:19 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6" returned: 0 in 0.274s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-f993d3aa-e0d3-4838-8d59-8794d24af0c6" released by "_copy_volume_from_snapshot" :: held 9.268s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-f4421fbd-4930-4186-9061-3ffa10665629-f993d3aa-e0d3-4838-8d59-8794d24af0c6" released by "_create_volume_from_snapshot" :: held 9.348s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.371s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-d0019dd5-f763-446d-a4b1-703c607a865e req-beb1f3e3-3292-4e87-ae0b-57db6bd03ba0 tempest-TestStampPattern-1882177794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.259s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-d0019dd5-f763-446d-a4b1-703c607a865e req-beb1f3e3-3292-4e87-ae0b-57db6bd03ba0 tempest-TestStampPattern-1882177794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.086s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1156027728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272ead5c-33dd-46e4-a220-d4ed23e7ddc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c28a1627a264d9c8a9f9c2b46bf4a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:19Z,use_quota=True,user_id='941b7b42a67745d981d69034573daac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Creating volume 272ead5c-33dd-46e4-a220-d4ed23e7ddc4 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:11:19 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f287e91-d92d-473b-8e27-6f48c149bb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6', 'volume_size': 1, 'snapshot_id': 'f4421fbd-4930-4186-9061-3ffa10665629'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:19 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 1073741824 Sep 17 17:11:19 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4ff6f8-0b5a-4320-8934-18ea4ad3f855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:19 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Volume volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 (f993d3aa-e0d3-4838-8d59-8794d24af0c6): created successfully Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4ff6f8-0b5a-4320-8934-18ea4ad3f855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Flow 'volume_create_manager' (26116455-3b8d-490d-b140-0bbab95dce03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-dde96897-f661-478c-941c-a407aeed86fa req-917021f5-edbc-4779-991e-fd05c6d3c7ea tempest-AttachVolumeTestJSON-117987046 None] Terminate volume connection completed successfully. Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-dde96897-f661-478c-941c-a407aeed86fa req-917021f5-edbc-4779-991e-fd05c6d3c7ea tempest-AttachVolumeTestJSON-117987046 None] Deleting attachment 58a8a726-caf1-4c5a-9492-72b4cb957ef0. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:11:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-d0019dd5-f763-446d-a4b1-703c607a865e req-beb1f3e3-3292-4e87-ae0b-57db6bd03ba0 tempest-TestStampPattern-1882177794 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '496057a8-2678-4ff8-bdf5-0414289c40c5', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:11:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a7b93269-2e52-40db-8710-8bcf9617da96 tempest-VolumesDeleteCascade-2051976207 None] Created volume successfully. Sep 17 17:11:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-d0019dd5-f763-446d-a4b1-703c607a865e req-beb1f3e3-3292-4e87-ae0b-57db6bd03ba0 tempest-TestStampPattern-1882177794 None] attachment_update completed successfully. Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Performing cascade delete. {{(pid=85889) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-f4421fbd-4930-4186-9061-3ffa10665629-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:20 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 1073741824" returned: 0 in 0.546s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-f4421fbd-4930-4186-9061-3ffa10665629-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" acquired by "delete_snapshot" :: waited 0.038s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-f4421fbd-4930-4186-9061-3ffa10665629" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:20 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 Sep 17 17:11:20 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-f4421fbd-4930-4186-9061-3ffa10665629" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Deleting offline snapshot f4421fbd-4930-4186-9061-3ffa10665629 of volume 5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] snapshot_file for this snap is: volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec964bb-09e8-46e9-8a96-677652f5dee9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:20 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 Sep 17 17:11:20 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:20 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4" returned: 0 in 0.457s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4f0936-9ff9-43b8-9eaa-1484f015b717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0250060d-634d-4763-8973-eda99bda2723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:20 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Volume volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 (272ead5c-33dd-46e4-a220-d4ed23e7ddc4): created successfully Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0250060d-634d-4763-8973-eda99bda2723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Flow 'volume_create_manager' (0b0da4a2-e538-40e4-8997-155612418235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:20 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b665d013-9746-4507-bd24-2328be964187 tempest-VolumesCloneTest-1872953422 None] Created volume successfully. Sep 17 17:11:20 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629" returned: 0 in 0.521s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4957f038-97d2-4c39-a21c-dcba596e2619]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:21 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 Sep 17 17:11:21 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:21 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" returned: 0 in 0.586s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:21 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 Sep 17 17:11:21 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Flow 'volume_create_manager' (54345bf5-5c23-4a12-becb-56bee51a71e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174a3eb8-c821-45d2-8748-21714b611b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174a3eb8-c821-45d2-8748-21714b611b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1510053647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff9fe18-4a5e-4185-abbe-bd5e9be67037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c28a1627a264d9c8a9f9c2b46bf4a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=272ead5c-33dd-46e4-a220-d4ed23e7ddc4,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:22Z,use_quota=True,user_id='941b7b42a67745d981d69034573daac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adb60fd-b881-472c-88ea-48d74100512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adb60fd-b881-472c-88ea-48d74100512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7495732-7c9c-4724-972d-194674162ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7495732-7c9c-4724-972d-194674162ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4ff9fe18-4a5e-4185-abbe-bd5e9be67037', 'volume_name': 'volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037', 'volume_size': 2, 'source_volid': '272ead5c-33dd-46e4-a220-d4ed23e7ddc4', 'source_volstatus': 'available'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4119b7db-f827-4078-a9a8-d63816f22eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4119b7db-f827-4078-a9a8-d63816f22eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c413d1f6-7e8f-464b-a107-a44d2eb21bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:21 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Volume 4ff9fe18-4a5e-4185-abbe-bd5e9be67037: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037', 'volume_size': 2, 'source_volid': '272ead5c-33dd-46e4-a220-d4ed23e7ddc4', 'source_volstatus': 'available'} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:21 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Cloning volume 272ead5c-33dd-46e4-a220-d4ed23e7ddc4 to volume 4ff9fe18-4a5e-4185-abbe-bd5e9be67037 Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Creating offline snapshot fd1a6943-92f3-40e2-ac22-5692e82031b5 of volume 272ead5c-33dd-46e4-a220-d4ed23e7ddc4 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bea816b-e00f-413d-af08-90ac405b9da9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:21 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629" returned: 0 in 0.371s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:22 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 Sep 17 17:11:22 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:22 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629 Sep 17 17:11:22 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:22 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752.f4421fbd-4930-4186-9061-3ffa10665629" returned: 0 in 0.274s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:22 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4" returned: 0 in 0.444s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:22 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:22 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-f4421fbd-4930-4186-9061-3ffa10665629" released by "_delete_snapshot" :: held 1.931s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" released by "delete_snapshot" :: held 1.966s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:22 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 1G Sep 17 17:11:22 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Created reservations ['4d80fd3f-531d-46ee-8794-8c8c7da0200f', 'bce5b528-f354-4452-bc1e-2bbf88cfcf28', '1093bdb1-1df2-4991-ad79-e6d8943ad0c1', '2533648c-dbae-422e-97b1-1f7358935bd7'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:22 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Delete snapshot completed successfully. Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-f4421fbd-4930-4186-9061-3ffa10665629-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Snapshots deleted, issuing volume delete {{(pid=85889) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" acquired by "delete_volume" :: waited 0.041s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:22 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[029810dc-308b-45e5-80f4-c569bd054089]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.447s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:11:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:11:22 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 Sep 17 17:11:22 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:23 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 1G" returned: 0 in 0.718s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:23 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 Sep 17 17:11:23 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:23 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" returned: 0 in 0.666s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:23 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752 Sep 17 17:11:23 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:23 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5" returned: 0 in 0.442s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:23 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 is being set with open permissions: ugo+rw Sep 17 17:11:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:23 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 Sep 17 17:11:23 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:23 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-229ea823-ec22-442a-8330-f3da61cc0f0f req-e29187ae-cb78-415b-b65d-1bce9a0ac33a tempest-TestStampPattern-1882177794 None] Terminate volume connection completed successfully. Sep 17 17:11:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-229ea823-ec22-442a-8330-f3da61cc0f0f req-e29187ae-cb78-415b-b65d-1bce9a0ac33a tempest-TestStampPattern-1882177794 None] Deleting attachment 496057a8-2678-4ff8-bdf5-0414289c40c5. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:11:23 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" returned: 0 in 0.531s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:23 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5" returned: 0 in 0.483s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752" released by "delete_volume" :: held 1.341s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:24 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.info Sep 17 17:11:24 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Created reservations ['598c7d2d-6425-4ad1-a105-a909fc9cb8a9', '629dae8e-e211-42c5-86a6-80ddd9365a40', '6d896e6e-f333-44f6-9d89-ce807425ffd3', '8bd94c94-ae0f-4fac-ae15-1129fc300e50'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:24 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:24 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:24 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.info" returned: 0 in 0.499s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:24 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.info is being set with open permissions: ugo+rw Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:24 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.info Sep 17 17:11:24 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:24 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.372s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:24 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Deleted volume successfully. Sep 17 17:11:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dc77cd97-8881-43e6-b1b1-346c8484ab2c tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-5a9795b6-3dbb-4cdc-8bce-b193f5a8a752-delete_volume" released by "delete_volume" :: held 4.626s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-f993d3aa-e0d3-4838-8d59-8794d24af0c6-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-f993d3aa-e0d3-4838-8d59-8794d24af0c6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:25 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.info" returned: 0 in 0.478s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Acquiring lock "cinder-quobyte-4ff9fe18-4a5e-4185-abbe-bd5e9be67037" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "cinder-quobyte-f993d3aa-e0d3-4838-8d59-8794d24af0c6" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Lock "cinder-quobyte-4ff9fe18-4a5e-4185-abbe-bd5e9be67037" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] snapshot: fd1a6943-92f3-40e2-ac22-5692e82031b5, volume: 4ff9fe18-4a5e-4185-abbe-bd5e9be67037, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-f993d3aa-e0d3-4838-8d59-8794d24af0c6" acquired by "delete_volume" :: waited 0.053s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b558ac06-104c-4bd8-889f-146b7a94d53e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a524fa-74a7-4435-a47e-f073da8b1d57]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:25 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 Sep 17 17:11:25 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:25 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 Sep 17 17:11:25 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:25 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5" returned: 0 in 0.752s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:11:25 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[acef02e1-a75f-4dff-8831-5fd25e4d2a78]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6" returned: 0 in 0.787s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:26 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6 Sep 17 17:11:26 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:26 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 Sep 17 17:11:26 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:26 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f993d3aa-e0d3-4838-8d59-8794d24af0c6" returned: 0 in 0.645s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-quobyte-f993d3aa-e0d3-4838-8d59-8794d24af0c6" released by "delete_volume" :: held 1.548s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:26 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Created reservations ['eb6e6424-7984-49c3-b221-8e2b71a854b7', '52b64d2f-ecbd-472d-a611-0eda6ac1af56', 'ee784f0b-4dd2-4711-894e-76e21d1de0c0', '1b298e50-d9f4-404f-9dbe-e758c3e2dad3'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:27 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4" returned: 0 in 1.209s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:27 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:27 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:27 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 Sep 17 17:11:27 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:27 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.884s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:27 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:27 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Deleted volume successfully. Sep 17 17:11:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-eedcd1a7-56aa-4ec0-82b9-b49ca223919e tempest-VolumesDeleteCascade-2051976207 None] Lock "cinder-f993d3aa-e0d3-4838-8d59-8794d24af0c6-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Acquiring lock "cinder-527760d0-a0bf-4ba0-8b54-3de28ea244f1-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Lock "cinder-527760d0-a0bf-4ba0-8b54-3de28ea244f1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Acquiring lock "cinder-quobyte-527760d0-a0bf-4ba0-8b54-3de28ea244f1" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-527760d0-a0bf-4ba0-8b54-3de28ea244f1" acquired by "delete_volume" :: waited 0.050s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:33 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1887e2f9-7892-4945-b4c2-97487cad54f2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:33 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 Sep 17 17:11:33 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:33 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1" returned: 0 in 0.784s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:34 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1 Sep 17 17:11:34 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:34 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-527760d0-a0bf-4ba0-8b54-3de28ea244f1" returned: 0 in 0.526s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-527760d0-a0bf-4ba0-8b54-3de28ea244f1" released by "delete_volume" :: held 1.434s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:34 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Created reservations ['5d6064a6-c5fe-4b61-89ee-fe0faccf8373', '04c9ae69-afc8-464d-99c8-39fed3f38401', '7f3fabbb-03c7-48eb-a1f8-cc2d54db4b42', 'e8bc5270-a0ad-4027-aeff-254cd0c4cf6d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:34 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:35 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:35 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.674s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:35 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:35 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Deleted volume successfully. Sep 17 17:11:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c2df80df-c86e-4968-a473-4195a898e62b tempest-TestStampPattern-1882177794 None] Lock "cinder-527760d0-a0bf-4ba0-8b54-3de28ea244f1-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Acquiring lock "cinder-26fe5b75-582f-4793-b7c5-9464a707025f-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Lock "cinder-26fe5b75-582f-4793-b7c5-9464a707025f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Acquiring lock "cinder-quobyte-5c310164-5350-46f9-b22b-137bfb6b1326" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-5c310164-5350-46f9-b22b-137bfb6b1326" acquired by "delete_snapshot" :: waited 0.062s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Acquiring lock "cinder-quobyte-26fe5b75-582f-4793-b7c5-9464a707025f" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-26fe5b75-582f-4793-b7c5-9464a707025f" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Deleting offline snapshot 26fe5b75-582f-4793-b7c5-9464a707025f of volume 5c310164-5350-46f9-b22b-137bfb6b1326 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:11:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] snapshot_file for this snap is: volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:11:36 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc96972-562e-45d4-a211-9d45f2a8c246]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:36 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f Sep 17 17:11:36 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:37 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f" returned: 0 in 1.152s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c310164-5350-46f9-b22b-137bfb6b1326(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:11:37 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa6555e-4dd2-491f-a0f1-66d9fa6ecdce]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:38 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 Sep 17 17:11:38 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:39 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037" returned: 0 in 11.795s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4, size 1024.00 MB, duration 11.80 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:11:39 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Converted 1024.00 MB image at 86.80 MB/s Sep 17 17:11:39 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 is being set with open permissions: ugo+rw Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:39 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 Sep 17 17:11:39 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:39 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326" returned: 0 in 1.371s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:39 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f Sep 17 17:11:39 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:39 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037" returned: 0 in 0.315s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Lock "cinder-quobyte-4ff9fe18-4a5e-4185-abbe-bd5e9be67037" released by "_copy_volume_from_snapshot" :: held 14.220s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Acquiring lock "cinder-quobyte-fd1a6943-92f3-40e2-ac22-5692e82031b5" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Lock "cinder-quobyte-fd1a6943-92f3-40e2-ac22-5692e82031b5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Deleting offline snapshot fd1a6943-92f3-40e2-ac22-5692e82031b5 of volume 272ead5c-33dd-46e4-a220-d4ed23e7ddc4 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] snapshot_file for this snap is: volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f7b6f-b122-4daa-9e06-204a11ae87ae]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:39 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f" returned: 0 in 0.421s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:39 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 Sep 17 17:11:39 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:39 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f Sep 17 17:11:39 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:39 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326.26fe5b75-582f-4793-b7c5-9464a707025f" returned: 0 in 0.282s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=120,cinder:SELECT=107,cinder:INSERT=30,cinder:DELETE=8 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-26fe5b75-582f-4793-b7c5-9464a707025f" released by "_delete_snapshot" :: held 3.489s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:39 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5" returned: 0 in 0.524s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-5c310164-5350-46f9-b22b-137bfb6b1326" released by "delete_snapshot" :: held 3.583s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b06361a-8159-414d-b281-260c386288e2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Created reservations ['744e51e7-63dc-4671-b72b-ea3909ba145a', 'e5ac9bdc-30b3-48e0-af83-b9aece085803', '16a89c79-c85b-4bc4-b78b-7db85dda969e', '111e9f43-48d0-4cc4-b87b-4c3d74b5407b'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Delete snapshot completed successfully. Sep 17 17:11:40 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 Sep 17 17:11:40 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-50db8909-daab-4c12-a2df-d0e2795a77ec tempest-TestStampPattern-1882177794 None] Lock "cinder-26fe5b75-582f-4793-b7c5-9464a707025f-delete_snapshot" released by "delete_snapshot" :: held 3.816s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=112,cinder:UPDATE=125,cinder:DELETE=13,cinder:INSERT=31 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Flow 'volume_create_manager' (f25135de-8630-4e9c-9200-a46e68122e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ee3d16-89ef-40f3-bc73-5fa1be9c1871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ee3d16-89ef-40f3-bc73-5fa1be9c1871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1514986396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afea2664-33ee-41f0-89c5-103a3cc2c60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccd1834953a46caab4507127c8aefb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:40Z,use_quota=True,user_id='e5f5644bad544a8ab1e873da3e588c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ab6b56-d224-4fd9-ae3c-61eb74d812ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ab6b56-d224-4fd9-ae3c-61eb74d812ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8199226e-b549-4443-9fa5-8be5f5caefad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8199226e-b549-4443-9fa5-8be5f5caefad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afea2664-33ee-41f0-89c5-103a3cc2c60d', 'volume_name': 'volume-afea2664-33ee-41f0-89c5-103a3cc2c60d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c69b15-3f15-46b6-a4bd-172303c7fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c69b15-3f15-46b6-a4bd-172303c7fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2d5396-c5a7-4bed-a7f3-8327fbc2fbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:40 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Volume afea2664-33ee-41f0-89c5-103a3cc2c60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afea2664-33ee-41f0-89c5-103a3cc2c60d', 'volume_size': 1} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:40 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4" returned: 0 in 0.605s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:40 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 Sep 17 17:11:40 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:40 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5" returned: 0 in 0.352s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:41 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5 Sep 17 17:11:41 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:41 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4.fd1a6943-92f3-40e2-ac22-5692e82031b5" returned: 0 in 0.266s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Lock "cinder-quobyte-fd1a6943-92f3-40e2-ac22-5692e82031b5" released by "_delete_snapshot" :: held 1.866s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.469s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.816s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1514986396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afea2664-33ee-41f0-89c5-103a3cc2c60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccd1834953a46caab4507127c8aefb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:40Z,use_quota=True,user_id='e5f5644bad544a8ab1e873da3e588c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Creating volume afea2664-33ee-41f0-89c5-103a3cc2c60d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:11:41 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c413d1f6-7e8f-464b-a107-a44d2eb21bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037', 'volume_size': 2, 'source_volid': '272ead5c-33dd-46e4-a220-d4ed23e7ddc4', 'source_volstatus': 'available'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c56975-3934-4a17-84ab-498cbe8e293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:41 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d 1073741824 Sep 17 17:11:41 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:41 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Volume volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 (4ff9fe18-4a5e-4185-abbe-bd5e9be67037): created successfully Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c56975-3934-4a17-84ab-498cbe8e293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Flow 'volume_create_manager' (54345bf5-5c23-4a12-becb-56bee51a71e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f0015339-803e-43e7-a73a-9829ffbfc6d4 tempest-VolumesCloneTest-1872953422 None] Created volume successfully. Sep 17 17:11:41 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d 1073741824" returned: 0 in 0.572s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:42 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d Sep 17 17:11:42 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:42 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d" returned: 0 in 0.527s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2d5396-c5a7-4bed-a7f3-8327fbc2fbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afea2664-33ee-41f0-89c5-103a3cc2c60d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427a432f-5572-42ee-b6e4-04dba6d4a9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:42 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Volume volume-afea2664-33ee-41f0-89c5-103a3cc2c60d (afea2664-33ee-41f0-89c5-103a3cc2c60d): created successfully Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427a432f-5572-42ee-b6e4-04dba6d4a9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Flow 'volume_create_manager' (f25135de-8630-4e9c-9200-a46e68122e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:42 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-88802a13-ed58-4be4-a173-fc198ad84976 tempest-VolumesTransfersV357Test-205279398 None] Created volume successfully. Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Acquiring lock "cinder-4ff9fe18-4a5e-4185-abbe-bd5e9be67037-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Lock "cinder-4ff9fe18-4a5e-4185-abbe-bd5e9be67037-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Acquiring lock "cinder-quobyte-4ff9fe18-4a5e-4185-abbe-bd5e9be67037" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Lock "cinder-quobyte-4ff9fe18-4a5e-4185-abbe-bd5e9be67037" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55af7fe-a099-49e5-8c4d-6a8e61218af1]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:42 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 Sep 17 17:11:42 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:43 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037" returned: 0 in 0.405s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:43 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037 Sep 17 17:11:43 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:43 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff9fe18-4a5e-4185-abbe-bd5e9be67037" returned: 0 in 0.322s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Lock "cinder-quobyte-4ff9fe18-4a5e-4185-abbe-bd5e9be67037" released by "delete_volume" :: held 0.786s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Created reservations ['116140f2-7773-49ac-b985-dcc5f98fc484', '25c6ce01-5b03-4209-a57e-ad92c76cc3af', '6a0a04ff-a7f8-4009-b4a6-a5a5a2069e22', '7459497a-0868-4770-993a-7a5e8c876e39'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:43 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:43 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Acquiring lock "cinder-272ead5c-33dd-46e4-a220-d4ed23e7ddc4-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:44 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Lock "cinder-272ead5c-33dd-46e4-a220-d4ed23e7ddc4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.304s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Deleted volume successfully. Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Acquiring lock "cinder-quobyte-272ead5c-33dd-46e4-a220-d4ed23e7ddc4" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-910be790-a889-4385-90c9-4c3ca4908a6e tempest-VolumesCloneTest-1872953422 None] Lock "cinder-4ff9fe18-4a5e-4185-abbe-bd5e9be67037-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Lock "cinder-quobyte-272ead5c-33dd-46e4-a220-d4ed23e7ddc4" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dade9525-995b-4deb-a684-fc6631d23766]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:44 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 Sep 17 17:11:44 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-617e9a92-9fce-4fc9-814a-7c02ef7c2926 tempest-VolumesTransfersV357Test-1566313628 None] Transfer volume completed successfully. Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Acquiring lock "cinder-5c310164-5350-46f9-b22b-137bfb6b1326-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Lock "cinder-5c310164-5350-46f9-b22b-137bfb6b1326-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Acquiring lock "cinder-quobyte-5c310164-5350-46f9-b22b-137bfb6b1326" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-5c310164-5350-46f9-b22b-137bfb6b1326" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca8c1c-c66d-4de6-abbd-47c2c77d70e1]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:44 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4" returned: 0 in 0.437s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:44 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4 Sep 17 17:11:44 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:44 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 Sep 17 17:11:44 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:44 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-272ead5c-33dd-46e4-a220-d4ed23e7ddc4" returned: 0 in 0.267s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Lock "cinder-quobyte-272ead5c-33dd-46e4-a220-d4ed23e7ddc4" released by "delete_volume" :: held 0.772s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Created reservations ['6fa2c5b7-e852-49f4-9beb-fa89fddd04c3', '9a73f662-cef3-4677-b44d-82c8d3ad48c5', '448367c9-a37f-4f13-a0b7-bf0edc53085e', 'c782950a-e11a-4abc-86c5-46705e7eb4e0'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:45 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326" returned: 0 in 0.403s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Acquiring lock "cinder-afea2664-33ee-41f0-89c5-103a3cc2c60d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:45 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326 Sep 17 17:11:45 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Lock "cinder-afea2664-33ee-41f0-89c5-103a3cc2c60d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Acquiring lock "cinder-quobyte-afea2664-33ee-41f0-89c5-103a3cc2c60d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Lock "cinder-quobyte-afea2664-33ee-41f0-89c5-103a3cc2c60d" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:45 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:45 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e527ad09-ac2c-48d7-883d-e7e51a61fb6c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:45 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d Sep 17 17:11:45 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:45 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5c310164-5350-46f9-b22b-137bfb6b1326" returned: 0 in 0.329s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Lock "cinder-quobyte-5c310164-5350-46f9-b22b-137bfb6b1326" released by "delete_volume" :: held 0.815s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:45 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.293s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Deleted volume successfully. Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Created reservations ['6288fe17-1874-4e3d-8ac2-c79ee97a73d4', 'fec7d4e7-5697-4ef9-bd88-acb09b950dc4', '9b791db3-20d1-4506-93bf-16ed75362e88', '163f5e17-222b-49e4-929a-6e2948e14dc6'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-859ca483-768e-423c-b090-75ab473b6b79 tempest-VolumesCloneTest-1872953422 None] Lock "cinder-272ead5c-33dd-46e4-a220-d4ed23e7ddc4-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:45 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:45 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:45 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d" returned: 0 in 0.491s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:45 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d Sep 17 17:11:45 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:45 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.386s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Deleted volume successfully. Sep 17 17:11:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-81ad7b26-b590-4735-ac91-26a9b329e810 tempest-TestStampPattern-1882177794 None] Lock "cinder-5c310164-5350-46f9-b22b-137bfb6b1326-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:46 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-afea2664-33ee-41f0-89c5-103a3cc2c60d" returned: 0 in 0.296s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Lock "cinder-quobyte-afea2664-33ee-41f0-89c5-103a3cc2c60d" released by "delete_volume" :: held 0.857s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Created reservations ['b7d8db71-c6a3-4a21-ab49-f5735a89aed1', '08a2dd34-04b2-4d96-bf93-b93431af0e1b', '3d3556c0-01ad-4689-85b9-60dc79ec8961', '7eab8928-b459-427a-a99d-e944292280d6'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:46 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:46 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:46 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.400s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Deleted volume successfully. Sep 17 17:11:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-de87bafa-1e4d-4649-8091-f5b42b5d54f8 tempest-VolumesTransfersV357Test-1678266986 None] Lock "cinder-afea2664-33ee-41f0-89c5-103a3cc2c60d-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Flow 'volume_create_manager' (caf82775-1ae1-4bb3-a41e-e68ead356b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728344e4-6ee2-4806-aadd-18c671e48d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728344e4-6ee2-4806-aadd-18c671e48d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1055818663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f2db7e-b89c-40be-86ea-d84a1365b9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccd1834953a46caab4507127c8aefb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:47Z,use_quota=True,user_id='e5f5644bad544a8ab1e873da3e588c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c94a5b-9586-44bb-a56f-51e083e520ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c94a5b-9586-44bb-a56f-51e083e520ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d991a5bc-4994-4b54-bcbf-91a1a4962680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d991a5bc-4994-4b54-bcbf-91a1a4962680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f2db7e-b89c-40be-86ea-d84a1365b9a9', 'volume_name': 'volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c164ef-b422-4d9a-ba88-69c525271c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c164ef-b422-4d9a-ba88-69c525271c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1161d9-95c9-41e3-821f-3e489d57c6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:47 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Volume 90f2db7e-b89c-40be-86ea-d84a1365b9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9', 'volume_size': 1} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1055818663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f2db7e-b89c-40be-86ea-d84a1365b9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccd1834953a46caab4507127c8aefb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:47Z,use_quota=True,user_id='e5f5644bad544a8ab1e873da3e588c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Creating volume 90f2db7e-b89c-40be-86ea-d84a1365b9a9 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:11:47 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:47 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9 1073741824 Sep 17 17:11:47 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:47 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9 1073741824" returned: 0 in 0.582s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:47 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9 Sep 17 17:11:47 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:48 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9" returned: 0 in 0.337s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:11:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1161d9-95c9-41e3-821f-3e489d57c6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca930815-7b63-4783-8a94-d0d12a584bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:48 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Volume volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9 (90f2db7e-b89c-40be-86ea-d84a1365b9a9): created successfully Sep 17 17:11:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca930815-7b63-4783-8a94-d0d12a584bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Flow 'volume_create_manager' (caf82775-1ae1-4bb3-a41e-e68ead356b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:48 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0b9862c0-ba78-41df-8b02-24ffb3ba4bb1 tempest-VolumesTransfersV357Test-205279398 None] Created volume successfully. Sep 17 17:11:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Acquiring lock "cinder-90f2db7e-b89c-40be-86ea-d84a1365b9a9-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Lock "cinder-90f2db7e-b89c-40be-86ea-d84a1365b9a9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Acquiring lock "cinder-quobyte-90f2db7e-b89c-40be-86ea-d84a1365b9a9" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Lock "cinder-quobyte-90f2db7e-b89c-40be-86ea-d84a1365b9a9" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:49 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3835e82-c726-472c-afa4-dc2145bc109e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:50 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9 Sep 17 17:11:50 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:50 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9" returned: 0 in 0.478s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:50 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9 Sep 17 17:11:50 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:50 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-90f2db7e-b89c-40be-86ea-d84a1365b9a9" returned: 0 in 0.452s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Lock "cinder-quobyte-90f2db7e-b89c-40be-86ea-d84a1365b9a9" released by "delete_volume" :: held 1.003s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:50 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Created reservations ['104ff06f-b3b5-4d96-b5cc-aa780dd79f4d', '110e1f89-622a-46d6-a4a2-238c17ef1ec0', 'ee7c0317-ac75-4e87-b777-e0bd162d5975', '9d182eda-bff1-4dd0-8c46-650c0795919c'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:50 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Flow 'volume_create_manager' (d4b0059a-5e73-433f-b236-15831bdba47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b2c0d8-13b0-43c7-852f-18df57104c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b2c0d8-13b0-43c7-852f-18df57104c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1548071177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c32d90-cc96-48d9-aab9-56698033dcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b8e845d4057432f88c9282f848c8d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:51Z,use_quota=True,user_id='0e3f0f02217d400f9f1e2fe9b0f73951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcc259f-d6cc-4557-9118-6a42ea4e6ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcc259f-d6cc-4557-9118-6a42ea4e6ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1909ea87-97b0-47a9-90e1-8c2316e4498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1909ea87-97b0-47a9-90e1-8c2316e4498f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c32d90-cc96-48d9-aab9-56698033dcf0', 'volume_name': 'volume-24c32d90-cc96-48d9-aab9-56698033dcf0', 'volume_size': 2}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e883aab3-a5fa-407a-9bca-ce34346fae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e883aab3-a5fa-407a-9bca-ce34346fae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3915a5ea-4408-4c8b-9959-85eae9ff7a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:51 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Volume 24c32d90-cc96-48d9-aab9-56698033dcf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c32d90-cc96-48d9-aab9-56698033dcf0', 'volume_size': 2} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1548071177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c32d90-cc96-48d9-aab9-56698033dcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b8e845d4057432f88c9282f848c8d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:11:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:11:51Z,use_quota=True,user_id='0e3f0f02217d400f9f1e2fe9b0f73951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Creating volume 24c32d90-cc96-48d9-aab9-56698033dcf0 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:11:51 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0 2147483648 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:51 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0 2147483648 Sep 17 17:11:51 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:51 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:51 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:51 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.324s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Deleted volume successfully. Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0a2c40ca-d7cf-412b-984e-5dfd9b9d4982 tempest-VolumesTransfersV357Test-1678266986 None] Lock "cinder-90f2db7e-b89c-40be-86ea-d84a1365b9a9-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:51 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0 2147483648" returned: 0 in 0.667s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:51 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0 Sep 17 17:11:51 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:52 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0" returned: 0 in 0.321s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:11:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3915a5ea-4408-4c8b-9959-85eae9ff7a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c32d90-cc96-48d9-aab9-56698033dcf0', 'volume_size': 2}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc4e9a5-c11d-4837-b240-8eec93a00ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:11:52 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Volume volume-24c32d90-cc96-48d9-aab9-56698033dcf0 (24c32d90-cc96-48d9-aab9-56698033dcf0): created successfully Sep 17 17:11:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc4e9a5-c11d-4837-b240-8eec93a00ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:11:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Flow 'volume_create_manager' (d4b0059a-5e73-433f-b236-15831bdba47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:11:52 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9c4f102c-a4fe-4b93-a43f-011bcc4add70 tempest-VolumesCloneNegativeTest-1942187005 None] Created volume successfully. Sep 17 17:11:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Acquiring lock "cinder-24c32d90-cc96-48d9-aab9-56698033dcf0-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Lock "cinder-24c32d90-cc96-48d9-aab9-56698033dcf0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Acquiring lock "cinder-quobyte-24c32d90-cc96-48d9-aab9-56698033dcf0" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:11:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Lock "cinder-quobyte-24c32d90-cc96-48d9-aab9-56698033dcf0" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:11:53 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b527f37-c755-40da-9043-d11bb3533426]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:11:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:53 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0 Sep 17 17:11:53 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:53 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0" returned: 0 in 0.475s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:53 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0 Sep 17 17:11:53 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:54 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-24c32d90-cc96-48d9-aab9-56698033dcf0" returned: 0 in 0.300s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Lock "cinder-quobyte-24c32d90-cc96-48d9-aab9-56698033dcf0" released by "delete_volume" :: held 0.860s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Created reservations ['0050c596-32ea-4d9c-8b7f-0a37448dc1af', '04fdc0a7-c943-4a89-91a5-df6f0c34974c', '30e97309-6c95-49f7-96cb-e6ca05ddfc4a', '55325f8e-bebf-45b2-b73b-ba867bf12377'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:11:54 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:11:54 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:11:54 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.278s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:11:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Deleted volume successfully. Sep 17 17:11:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-aafc2783-fe52-40c0-ae32-b04806a3a017 tempest-VolumesCloneNegativeTest-1942187005 None] Lock "cinder-24c32d90-cc96-48d9-aab9-56698033dcf0-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:01 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Flow 'volume_create_manager' (6f8f4301-1609-4830-9404-dfc4f97f795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90de0f50-0fab-4024-9c2f-5dfbafe8a3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90de0f50-0fab-4024-9c2f-5dfbafe8a3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-282099964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9ed8e0-924d-4b25-84ca-ec361e8edf43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359b93b78e704b12a7f123a5315b5b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:02Z,use_quota=True,user_id='181da240c6674679b0e4fc4a3dd37732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1384b223-631d-4798-a690-c2e19584dbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1384b223-631d-4798-a690-c2e19584dbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eda4437-20bd-4e08-946f-055979945fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:02 devstack cinder-volume[85889]: DEBUG cinder.image.glance [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Creating Keystone auth plugin from conf {{(pid=85889) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 17:12:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eda4437-20bd-4e08-946f-055979945fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe9ed8e0-924d-4b25-84ca-ec361e8edf43', 'volume_name': 'volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c562832-234d-4e6f-b3f3-340b793bbdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c562832-234d-4e6f-b3f3-340b793bbdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c194cb-10cc-435a-8b72-3c8a0494ab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:03 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Volume fe9ed8e0-924d-4b25-84ca-ec361e8edf43: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 17:12:03 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Trying to clone fe9ed8e0-924d-4b25-84ca-ec361e8edf43 from image 7afddb82-049d-4cb0-9488-82066e4ce33b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]). {{(pid=85889) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 17:12:03 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 17:12:03 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Image download 20.69 MB at 20.69 MB/s Sep 17 17:12:03 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e14e82-06b0-4732-bce7-8adbdc03e89d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:03 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD Sep 17 17:12:03 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:04 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Temporary image 7afddb82-049d-4cb0-9488-82066e4ce33b is fetched for user 181da240c6674679b0e4fc4a3dd37732. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d590002c-d67b-42f2-9941-522a0acf3574]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:04 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD Sep 17 17:12:04 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:04 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-282099964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9ed8e0-924d-4b25-84ca-ec361e8edf43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359b93b78e704b12a7f123a5315b5b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:02Z,use_quota=True,user_id='181da240c6674679b0e4fc4a3dd37732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Creating volume fe9ed8e0-924d-4b25-84ca-ec361e8edf43 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:04 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:04 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 1073741824 Sep 17 17:12:04 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:05 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 1073741824" returned: 0 in 0.754s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:05 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 Sep 17 17:12:05 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:05 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43" returned: 0 in 0.311s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:05 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Attempting download of 7afddb82-049d-4cb0-9488-82066e4ce33b ((None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}])) to volume fe9ed8e0-924d-4b25-84ca-ec361e8edf43. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 17:12:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e008da6-61fa-4acb-8847-58e3afa52b5d]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_d8iupph7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:06 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_d8iupph7 Sep 17 17:12:06 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:06 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_d8iupph7" returned: 0 in 0.568s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_d8iupph7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:06 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_d8iupph7 Sep 17 17:12:06 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:07 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_d8iupph7" returned: 1 in 0.599s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_d8iupph7' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:12:07 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afc601e-9498-4948-b895-eb65cb5db454]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:07 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD Sep 17 17:12:07 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:07 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD" returned: 0 in 0.626s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:07 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] 7afddb82-049d-4cb0-9488-82066e4ce33b was qcow2, converting to qcow2 {{(pid=85889) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 17:12:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:07 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 Sep 17 17:12:07 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:10 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Flow 'volume_create_manager' (bd69f2e1-c75a-48a0-b664-7b76e2d77e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc82d7d-0254-43be-8a4a-ae4b4787b877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc82d7d-0254-43be-8a4a-ae4b4787b877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49692bd5-535b-4e06-b1f3-f4af64d2f633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccda5e47bed744d1b70f74f15d8705a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:10Z,use_quota=True,user_id='dc57a64a45254b5c810b6301b1079e86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19755e80-bf04-4760-8e8f-969553d86de3),volume_type_id=19755e80-bf04-4760-8e8f-969553d86de3)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bc0e5f-a5e2-44b9-bd2a-00df621f8dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bc0e5f-a5e2-44b9-bd2a-00df621f8dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9a8b25-3317-4f15-8828-a5f2708311db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:10 devstack cinder-volume[85889]: DEBUG cinder.image.glance [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Creating Keystone auth plugin from conf {{(pid=85889) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9a8b25-3317-4f15-8828-a5f2708311db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49692bd5-535b-4e06-b1f3-f4af64d2f633', 'volume_name': 'volume-49692bd5-535b-4e06-b1f3-f4af64d2f633', 'volume_size': 1, 'image_id': 'e437177d-cd88-4cfd-868e-02932f1c7329', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e437177d-cd88-4cfd-868e-02932f1c7329', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb12497d91ccf41132424258b87bc715', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ccda5e47bed744d1b70f74f15d8705a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75a335c422950fc71d19d4c62b2308fbfa23b4a4fcdcfe493f201e1c8f8dfaa8e618f8dea01f6154de22d958e7c756d36b9b13f8b9b1500de31b3c40a2d90279', 'id': 'e437177d-cd88-4cfd-868e-02932f1c7329', 'created_at': datetime.datetime(2026, 9, 17, 15, 12, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 12, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e437177d-cd88-4cfd-868e-02932f1c7329/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d367ef-08da-4185-8983-0a8264d1423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d367ef-08da-4185-8983-0a8264d1423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87416934-f3fd-437a-9793-a846ae2c3fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:11 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Volume 49692bd5-535b-4e06-b1f3-f4af64d2f633: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49692bd5-535b-4e06-b1f3-f4af64d2f633', 'volume_size': 1, 'image_id': 'e437177d-cd88-4cfd-868e-02932f1c7329', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e437177d-cd88-4cfd-868e-02932f1c7329', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb12497d91ccf41132424258b87bc715', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ccda5e47bed744d1b70f74f15d8705a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75a335c422950fc71d19d4c62b2308fbfa23b4a4fcdcfe493f201e1c8f8dfaa8e618f8dea01f6154de22d958e7c756d36b9b13f8b9b1500de31b3c40a2d90279', 'id': 'e437177d-cd88-4cfd-868e-02932f1c7329', 'created_at': datetime.datetime(2026, 9, 17, 15, 12, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 12, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e437177d-cd88-4cfd-868e-02932f1c7329/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Trying to clone 49692bd5-535b-4e06-b1f3-f4af64d2f633 from image e437177d-cd88-4cfd-868e-02932f1c7329 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e437177d-cd88-4cfd-868e-02932f1c7329', 'metadata': {}}]). {{(pid=85889) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 17:12:11 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Image download 0.00 MB at 0.00 MB/s Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[018e69b3-76f2-4ca5-a2f5-e04dc8dbec7a]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:11 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43" returned: 0 in 3.788s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_skb88dfmdevstack@QuobyteHD, size 112.00 MB, duration 3.79 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:12:11 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Converted 112.00 MB image at 29.55 MB/s Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:11 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 1G Sep 17 17:12:11 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:11 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD Sep 17 17:12:11 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:11 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD" returned: 0 in 0.469s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:12 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD Sep 17 17:12:12 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:12 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 1G" returned: 0 in 0.685s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Downloaded image 7afddb82-049d-4cb0-9488-82066e4ce33b ((None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}])) to volume fe9ed8e0-924d-4b25-84ca-ec361e8edf43 successfully. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Temporary image 7afddb82-049d-4cb0-9488-82066e4ce33b for user 181da240c6674679b0e4fc4a3dd37732 is deleted. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Marking volume fe9ed8e0-924d-4b25-84ca-ec361e8edf43 as bootable. {{(pid=85889) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Copying metadata from image 7afddb82-049d-4cb0-9488-82066e4ce33b to fe9ed8e0-924d-4b25-84ca-ec361e8edf43. {{(pid=85889) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Creating volume glance metadata for volume fe9ed8e0-924d-4b25-84ca-ec361e8edf43 backed by image 7afddb82-049d-4cb0-9488-82066e4ce33b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85889) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 17:12:12 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD" returned: 1 in 0.475s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Temporary image e437177d-cd88-4cfd-868e-02932f1c7329 is fetched for user dc57a64a45254b5c810b6301b1079e86. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c194cb-10cc-435a-8b72-3c8a0494ab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8597b01b-2433-46cf-8ce4-391ef1fad197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:12 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Volume volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 (fe9ed8e0-924d-4b25-84ca-ec361e8edf43): created successfully Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8597b01b-2433-46cf-8ce4-391ef1fad197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Flow 'volume_create_manager' (6f8f4301-1609-4830-9404-dfc4f97f795c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:12 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f8b151a3-8d30-463c-ae4e-353279291d54 tempest-VolumesExtendTest-1978745452 None] Created volume successfully. Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38dfb9e-8c73-42a2-a36a-88f78f60fc4f]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:12 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD Sep 17 17:12:12 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:13 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD" returned: 0 in 0.490s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:13 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD Sep 17 17:12:13 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3bfdec86-e679-4bf9-ba53-d9532c1122a7 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3bfdec86-e679-4bf9-ba53-d9532c1122a7 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:13 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea71d24-3761-4846-a44f-7306bb398d6a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3bfdec86-e679-4bf9-ba53-d9532c1122a7 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:13 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD" returned: 1 in 0.584s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:12:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:13 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 Sep 17 17:12:13 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:13 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3bfdec86-e679-4bf9-ba53-d9532c1122a7 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43" returned: 0 in 0.532s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3bfdec86-e679-4bf9-ba53-d9532c1122a7 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 2G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3bfdec86-e679-4bf9-ba53-d9532c1122a7 tempest-VolumesExtendTest-1978745452 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 2G" returned: 0 in 0.206s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3bfdec86-e679-4bf9-ba53-d9532c1122a7 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.779s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.619s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49692bd5-535b-4e06-b1f3-f4af64d2f633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccda5e47bed744d1b70f74f15d8705a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:10Z,use_quota=True,user_id='dc57a64a45254b5c810b6301b1079e86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19755e80-bf04-4760-8e8f-969553d86de3),volume_type_id=19755e80-bf04-4760-8e8f-969553d86de3)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Creating volume 49692bd5-535b-4e06-b1f3-f4af64d2f633 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:14 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:14 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 1073741824 Sep 17 17:12:14 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:14 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3bfdec86-e679-4bf9-ba53-d9532c1122a7 tempest-VolumesExtendTest-1978745452 None] Extend volume completed successfully. Sep 17 17:12:15 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 1073741824" returned: 0 in 0.837s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:15 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 Sep 17 17:12:15 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "cinder-fe9ed8e0-924d-4b25-84ca-ec361e8edf43-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-fe9ed8e0-924d-4b25-84ca-ec361e8edf43-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "cinder-quobyte-fe9ed8e0-924d-4b25-84ca-ec361e8edf43" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-quobyte-fe9ed8e0-924d-4b25-84ca-ec361e8edf43" acquired by "delete_volume" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee48024c-46a8-44e2-b2e4-e1028fd7a3c6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:15 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 Sep 17 17:12:15 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:15 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633" returned: 0 in 0.591s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Attempting download of e437177d-cd88-4cfd-868e-02932f1c7329 ((None, [{'url': 'file:///opt/stack/data/glance/images/e437177d-cd88-4cfd-868e-02932f1c7329', 'metadata': {}}])) to volume 49692bd5-535b-4e06-b1f3-f4af64d2f633. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd357608-a7a6-4a8a-9006-f2a2f130ff73]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e437177d-cd88-4cfd-868e-02932f1c7329_pm31fn5v {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:16 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e437177d-cd88-4cfd-868e-02932f1c7329_pm31fn5v Sep 17 17:12:16 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:16 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43" returned: 0 in 0.862s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:16 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43 Sep 17 17:12:16 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:16 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e437177d-cd88-4cfd-868e-02932f1c7329_pm31fn5v" returned: 0 in 0.673s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e437177d-cd88-4cfd-868e-02932f1c7329_pm31fn5v {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:16 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fe9ed8e0-924d-4b25-84ca-ec361e8edf43" returned: 0 in 0.358s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-quobyte-fe9ed8e0-924d-4b25-84ca-ec361e8edf43" released by "delete_volume" :: held 1.286s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Created reservations ['836784b1-ca4e-431f-8107-e5051c532620', '839a97cd-9cc4-4f72-92ca-315c2b33a60c', '0267938b-7bd2-4a7c-964c-c7543d5d44e5', 'a93fa915-3337-466f-8415-3da80de0dcb0'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:16 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e437177d-cd88-4cfd-868e-02932f1c7329_pm31fn5v Sep 17 17:12:16 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:17 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:17 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:17 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e437177d-cd88-4cfd-868e-02932f1c7329_pm31fn5v" returned: 1 in 0.525s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e437177d-cd88-4cfd-868e-02932f1c7329_pm31fn5v' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ea2ab3-dc57-4adc-9386-e2726f8ae7c4]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:17 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.352s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:17 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD Sep 17 17:12:17 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:17 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Deleted volume successfully. Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1eacbe6-7e50-415b-981c-fb8a30089141 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-fe9ed8e0-924d-4b25-84ca-ec361e8edf43-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:17 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:17 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD Sep 17 17:12:17 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:17 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD" returned: 1 in 0.346s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] e437177d-cd88-4cfd-868e-02932f1c7329 was raw, converting to qcow2 {{(pid=85889) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 17:12:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:17 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 Sep 17 17:12:17 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Flow 'volume_create_manager' (6e5b27bf-a6c4-40cb-9699-c16482e65006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e27b5fd-02fd-4595-8f9e-8906125c8dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e27b5fd-02fd-4595-8f9e-8906125c8dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1961598348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55576778-0d30-47a3-a34f-1b0930b9701d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359b93b78e704b12a7f123a5315b5b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:18Z,use_quota=True,user_id='181da240c6674679b0e4fc4a3dd37732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30096c40-a351-42a4-b854-9ecf13f2b497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30096c40-a351-42a4-b854-9ecf13f2b497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660456c4-4a6c-4f51-99df-ffc095bf16b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660456c4-4a6c-4f51-99df-ffc095bf16b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55576778-0d30-47a3-a34f-1b0930b9701d', 'volume_name': 'volume-55576778-0d30-47a3-a34f-1b0930b9701d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eadc291-eaae-4993-a7b2-35f2776595b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eadc291-eaae-4993-a7b2-35f2776595b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43947763-328a-4655-9e9f-f30b8086f5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:18 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Volume 55576778-0d30-47a3-a34f-1b0930b9701d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55576778-0d30-47a3-a34f-1b0930b9701d', 'volume_size': 1} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1961598348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55576778-0d30-47a3-a34f-1b0930b9701d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359b93b78e704b12a7f123a5315b5b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:18Z,use_quota=True,user_id='181da240c6674679b0e4fc4a3dd37732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Creating volume 55576778-0d30-47a3-a34f-1b0930b9701d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:18 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:18 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d 1073741824 Sep 17 17:12:18 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:18 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Flow 'volume_create_manager' (f5466573-061a-49bc-87e1-fb9e8bac9570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7509f40e-2913-4ded-a83b-eb11f439660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633" returned: 0 in 0.752s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e437177d-cd88-4cfd-868e-02932f1c7329_d328as45devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:12:18 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7509f40e-2913-4ded-a83b-eb11f439660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1779508781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f9b759-803d-4a28-a2eb-ac75b45787f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35eaf848aae343f5b7f9f6f8ac89d1f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:19Z,use_quota=True,user_id='4f92ef23058c4243b4cfcb2420a50e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075f910b-22f6-428b-9552-b1b5296a94d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:18 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 1G Sep 17 17:12:18 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075f910b-22f6-428b-9552-b1b5296a94d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948d363f-9dd3-4186-91a0-6a237bfc83b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948d363f-9dd3-4186-91a0-6a237bfc83b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f9b759-803d-4a28-a2eb-ac75b45787f1', 'volume_name': 'volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98801b17-b18b-4e60-9c0b-d9cd2ee6c743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98801b17-b18b-4e60-9c0b-d9cd2ee6c743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a6bd5b-b81b-404c-9502-dfd366639d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:18 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Volume d3f9b759-803d-4a28-a2eb-ac75b45787f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1', 'volume_size': 1} Sep 17 17:12:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:19 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d 1073741824" returned: 0 in 0.499s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:19 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 1G" returned: 0 in 0.375s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Downloaded image e437177d-cd88-4cfd-868e-02932f1c7329 ((None, [{'url': 'file:///opt/stack/data/glance/images/e437177d-cd88-4cfd-868e-02932f1c7329', 'metadata': {}}])) to volume 49692bd5-535b-4e06-b1f3-f4af64d2f633 successfully. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Temporary image e437177d-cd88-4cfd-868e-02932f1c7329 for user dc57a64a45254b5c810b6301b1079e86 is deleted. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Marking volume 49692bd5-535b-4e06-b1f3-f4af64d2f633 as bootable. {{(pid=85889) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Copying metadata from image e437177d-cd88-4cfd-868e-02932f1c7329 to 49692bd5-535b-4e06-b1f3-f4af64d2f633. {{(pid=85889) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Creating volume glance metadata for volume 49692bd5-535b-4e06-b1f3-f4af64d2f633 backed by image e437177d-cd88-4cfd-868e-02932f1c7329 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e437177d-cd88-4cfd-868e-02932f1c7329', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'eb12497d91ccf41132424258b87bc715', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85889) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 17:12:19 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d Sep 17 17:12:19 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87416934-f3fd-437a-9793-a846ae2c3fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49692bd5-535b-4e06-b1f3-f4af64d2f633', 'volume_size': 1, 'image_id': 'e437177d-cd88-4cfd-868e-02932f1c7329', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e437177d-cd88-4cfd-868e-02932f1c7329', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb12497d91ccf41132424258b87bc715', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ccda5e47bed744d1b70f74f15d8705a5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75a335c422950fc71d19d4c62b2308fbfa23b4a4fcdcfe493f201e1c8f8dfaa8e618f8dea01f6154de22d958e7c756d36b9b13f8b9b1500de31b3c40a2d90279', 'id': 'e437177d-cd88-4cfd-868e-02932f1c7329', 'created_at': datetime.datetime(2026, 9, 17, 15, 12, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 12, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e437177d-cd88-4cfd-868e-02932f1c7329/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6beed4-679f-42d5-8f66-db873748e262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:19 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Volume volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 (49692bd5-535b-4e06-b1f3-f4af64d2f633): created successfully Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6beed4-679f-42d5-8f66-db873748e262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Flow 'volume_create_manager' (bd69f2e1-c75a-48a0-b664-7b76e2d77e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0e51decf-a5f7-4e30-8731-fae952a8311d tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Created volume successfully. Sep 17 17:12:19 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d" returned: 0 in 0.296s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1779508781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f9b759-803d-4a28-a2eb-ac75b45787f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35eaf848aae343f5b7f9f6f8ac89d1f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:19Z,use_quota=True,user_id='4f92ef23058c4243b4cfcb2420a50e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Creating volume d3f9b759-803d-4a28-a2eb-ac75b45787f1 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:19 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43947763-328a-4655-9e9f-f30b8086f5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55576778-0d30-47a3-a34f-1b0930b9701d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:19 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 1073741824 Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31d1b98-6054-4910-853c-5c5706c5621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:19 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:19 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Volume volume-55576778-0d30-47a3-a34f-1b0930b9701d (55576778-0d30-47a3-a34f-1b0930b9701d): created successfully Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31d1b98-6054-4910-853c-5c5706c5621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Flow 'volume_create_manager' (6e5b27bf-a6c4-40cb-9699-c16482e65006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4684df75-6ef7-4782-b4e2-60e986c05d2d tempest-VolumesExtendTest-1978745452 None] Created volume successfully. Sep 17 17:12:19 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 1073741824" returned: 0 in 0.448s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:19 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 Sep 17 17:12:19 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:20 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1" returned: 0 in 0.254s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a6bd5b-b81b-404c-9502-dfd366639d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2d4994-487c-4852-a57d-aff1372bcec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:20 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Volume volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 (d3f9b759-803d-4a28-a2eb-ac75b45787f1): created successfully Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2d4994-487c-4852-a57d-aff1372bcec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Flow 'volume_create_manager' (f5466573-061a-49bc-87e1-fb9e8bac9570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:20 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-38f418f1-41c7-4647-a3fd-a372db5bbb9c tempest-VolumesActionsTest-863745633 None] Created volume successfully. Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Acquiring lock "cinder-49692bd5-535b-4e06-b1f3-f4af64d2f633-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Lock "cinder-49692bd5-535b-4e06-b1f3-f4af64d2f633-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Acquiring lock "cinder-quobyte-49692bd5-535b-4e06-b1f3-f4af64d2f633" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Lock "cinder-quobyte-49692bd5-535b-4e06-b1f3-f4af64d2f633" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d05012c-3ca0-40a9-8ecc-11a378e70e77]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:20 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 Sep 17 17:12:20 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Creating offline snapshot 45d279ac-5353-4b25-9dba-d2c33c128131 of volume 55576778-0d30-47a3-a34f-1b0930b9701d {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d147d05-dd5a-4238-9d33-c1a8136fde73]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:20 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d Sep 17 17:12:20 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:21 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633" returned: 0 in 0.565s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:21 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633 Sep 17 17:12:21 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:21 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d" returned: 0 in 0.396s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:21 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 1G Sep 17 17:12:21 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:21 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-49692bd5-535b-4e06-b1f3-f4af64d2f633" returned: 0 in 0.277s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Lock "cinder-quobyte-49692bd5-535b-4e06-b1f3-f4af64d2f633" released by "delete_volume" :: held 0.915s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:21 devstack cinder-volume[85889]: WARNING cinder.quota [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:12:21 devstack cinder-volume[85889]: WARNING cinder.quota [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Created reservations ['2af65c98-69b3-49ce-8cfa-b0d597be3963', '5dd0cddc-722d-45d4-9a4c-47b8dee7476c', '12429e83-4a16-4f1a-9ceb-bc5be51becbf', '1c24e395-ea6e-4808-9571-42b9a4e03216'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:21 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:21 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:21 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 1G" returned: 0 in 0.508s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55576778-0d30-47a3-a34f-1b0930b9701d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:21 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55576778-0d30-47a3-a34f-1b0930b9701d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 Sep 17 17:12:21 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:21 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.270s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:21 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Deleted volume successfully. Sep 17 17:12:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3eb7e6d5-6981-4b40-9fe9-105c23169b8e tempest-VolumeAndVolumeTypeFromImageTest-1540510199 None] Lock "cinder-49692bd5-535b-4e06-b1f3-f4af64d2f633-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:22 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55576778-0d30-47a3-a34f-1b0930b9701d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131" returned: 0 in 0.330s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:22 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 is being set with open permissions: ugo+rw Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:22 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 Sep 17 17:12:22 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:22 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:22 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:22 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131" returned: 0 in 0.285s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:22 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.info Sep 17 17:12:22 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:22 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.271s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:12:22 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.info" returned: 0 in 0.289s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:22 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.info is being set with open permissions: ugo+rw Sep 17 17:12:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:22 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.info Sep 17 17:12:22 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:23 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.info" returned: 0 in 0.327s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:23 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5c6e66cd-673f-479a-b612-82760824d73f tempest-VolumesExtendTest-1978745452 None] Create snapshot completed successfully Sep 17 17:12:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-230cab30-558b-4043-be51-f21d1d12dac5 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-230cab30-558b-4043-be51-f21d1d12dac5 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:24 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5caf3a-ce0e-4a43-b261-eab526a55486]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-230cab30-558b-4043-be51-f21d1d12dac5 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:24 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d Sep 17 17:12:24 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:24 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-230cab30-558b-4043-be51-f21d1d12dac5 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d" returned: 0 in 0.465s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-230cab30-558b-4043-be51-f21d1d12dac5 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 2G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-230cab30-558b-4043-be51-f21d1d12dac5 tempest-VolumesExtendTest-1978745452 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 2G" returned: 0 in 0.163s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-230cab30-558b-4043-be51-f21d1d12dac5 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.687s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:25 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-230cab30-558b-4043-be51-f21d1d12dac5 tempest-VolumesExtendTest-1978745452 None] Extend volume completed successfully. Sep 17 17:12:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "cinder-45d279ac-5353-4b25-9dba-d2c33c128131-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-45d279ac-5353-4b25-9dba-d2c33c128131-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "cinder-quobyte-55576778-0d30-47a3-a34f-1b0930b9701d" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-quobyte-55576778-0d30-47a3-a34f-1b0930b9701d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "cinder-quobyte-45d279ac-5353-4b25-9dba-d2c33c128131" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-quobyte-45d279ac-5353-4b25-9dba-d2c33c128131" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Deleting offline snapshot 45d279ac-5353-4b25-9dba-d2c33c128131 of volume 55576778-0d30-47a3-a34f-1b0930b9701d {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:12:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] snapshot_file for this snap is: volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:12:25 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb3124b-8b71-4e02-b14f-bf952543237b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:25 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 Sep 17 17:12:25 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:26 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131" returned: 0 in 0.574s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55576778-0d30-47a3-a34f-1b0930b9701d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:12:26 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea0ed1-9539-44a4-bd2b-68483015af0f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:26 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d Sep 17 17:12:26 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:27 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d" returned: 0 in 0.672s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:27 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 Sep 17 17:12:27 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:27 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131" returned: 0 in 0.807s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:27 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131 Sep 17 17:12:27 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:28 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d.45d279ac-5353-4b25-9dba-d2c33c128131" returned: 0 in 0.367s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-quobyte-45d279ac-5353-4b25-9dba-d2c33c128131" released by "_delete_snapshot" :: held 2.723s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-quobyte-55576778-0d30-47a3-a34f-1b0930b9701d" released by "delete_snapshot" :: held 2.784s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:28 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Created reservations ['01106016-b612-499c-a8e7-82ac60e83bd0', '0341bdd2-a891-440c-8cb9-70e397383e55', '1d23b449-4410-4828-a5c6-be2201ea5f8e', '9599b4dd-1aad-4f51-833d-c081428098f2'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:28 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Delete snapshot completed successfully. Sep 17 17:12:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b51e5afa-baa0-4648-ab2c-67e3d916ef80 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-45d279ac-5353-4b25-9dba-d2c33c128131-delete_snapshot" released by "delete_snapshot" :: held 3.168s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "cinder-55576778-0d30-47a3-a34f-1b0930b9701d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-55576778-0d30-47a3-a34f-1b0930b9701d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "cinder-quobyte-55576778-0d30-47a3-a34f-1b0930b9701d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-quobyte-55576778-0d30-47a3-a34f-1b0930b9701d" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:29 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f097bb-0d44-4ef7-8f9a-b7491bba7fb2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:29 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d Sep 17 17:12:29 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:29 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d" returned: 0 in 0.547s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:29 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d Sep 17 17:12:29 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:29 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-55576778-0d30-47a3-a34f-1b0930b9701d" returned: 0 in 0.335s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-quobyte-55576778-0d30-47a3-a34f-1b0930b9701d" released by "delete_volume" :: held 0.971s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Created reservations ['529de7f5-8447-40a9-b846-cadbd6ec87a6', 'a914927f-f7b9-4011-891c-9ef08ff04d3b', '3812fe82-7693-446f-bcea-a37b22981c02', '1e74425c-aa1e-4c66-ad05-49dd2cf9cb3c'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:30 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:30 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-66161729-6d45-4667-99b0-d37ee1e07367 tempest-VolumesActionsTest-863745633 None] Acquiring lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1" by "attach_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-66161729-6d45-4667-99b0-d37ee1e07367 tempest-VolumesActionsTest-863745633 None] Lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1" acquired by "attach_volume" :: waited 0.047s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Flow 'volume_create_manager' (3eca1da1-72b7-40a1-a259-50ff378c2f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c479aa-fef1-4941-8acb-5226409c6395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c479aa-fef1-4941-8acb-5226409c6395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1221294022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a8b491-649c-4fc9-b480-23423aefbb61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19a3f7998241f8a804767427813e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:30Z,use_quota=True,user_id='e8d36c6ee429434088ba109989e3f316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39399bd0-fa08-457c-9f68-e85f1b12e785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39399bd0-fa08-457c-9f68-e85f1b12e785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df272e68-6dbf-493e-b068-500b59fa849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df272e68-6dbf-493e-b068-500b59fa849e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a8b491-649c-4fc9-b480-23423aefbb61', 'volume_name': 'volume-d4a8b491-649c-4fc9-b480-23423aefbb61', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ab6e11-be6d-40d9-b192-170c7f0f2525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ab6e11-be6d-40d9-b192-170c7f0f2525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11a5e4b-646f-4c73-8c2e-17b5b680e93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Volume d4a8b491-649c-4fc9-b480-23423aefbb61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a8b491-649c-4fc9-b480-23423aefbb61', 'volume_size': 1} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1221294022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a8b491-649c-4fc9-b480-23423aefbb61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19a3f7998241f8a804767427813e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:30Z,use_quota=True,user_id='e8d36c6ee429434088ba109989e3f316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Creating volume d4a8b491-649c-4fc9-b480-23423aefbb61 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:30 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:30 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61 1073741824 Sep 17 17:12:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-66161729-6d45-4667-99b0-d37ee1e07367 tempest-VolumesActionsTest-863745633 None] Attaching volume d3f9b759-803d-4a28-a2eb-ac75b45787f1 to instance fc603793-0b14-4b53-8ec2-5a9d084e4bc7 at mountpoint /dev/vdb on host None. Sep 17 17:12:30 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-66161729-6d45-4667-99b0-d37ee1e07367 tempest-VolumesActionsTest-863745633 None] Attach volume completed successfully. Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:30 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Flow 'volume_create_manager' (339d4ed2-0fa2-491a-bb44-43415ca8d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0480901e-77b1-46d2-9abb-2e52619313f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-66161729-6d45-4667-99b0-d37ee1e07367 tempest-VolumesActionsTest-863745633 None] Lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1" released by "attach_volume" :: held 0.512s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.628s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Deleted volume successfully. Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0480901e-77b1-46d2-9abb-2e52619313f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1441493587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea31069-2f9d-415d-b676-98179703e092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19a3f7998241f8a804767427813e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:31Z,use_quota=True,user_id='e8d36c6ee429434088ba109989e3f316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e9adad-db6e-4773-8c9e-8060c503eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e9adad-db6e-4773-8c9e-8060c503eec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13f5264-32e8-4259-80f1-cb30416bd8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13f5264-32e8-4259-80f1-cb30416bd8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea31069-2f9d-415d-b676-98179703e092', 'volume_name': 'volume-eea31069-2f9d-415d-b676-98179703e092', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7504335-84b8-4527-9314-9626dee08206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7504335-84b8-4527-9314-9626dee08206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5dea51-f692-4ba7-ae3d-9c6067a32f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:31 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Volume eea31069-2f9d-415d-b676-98179703e092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea31069-2f9d-415d-b676-98179703e092', 'volume_size': 1} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c178419-7f76-4912-8809-b544c56cbb28 tempest-VolumesExtendTest-1978745452 None] Lock "cinder-55576778-0d30-47a3-a34f-1b0930b9701d-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45b86ea5-0a96-4a9b-acf7-45b737e04ecf tempest-VolumesActionsTest-863745633 None] Acquiring lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1-detach_volume" by "detach_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45b86ea5-0a96-4a9b-acf7-45b737e04ecf tempest-VolumesActionsTest-863745633 None] Lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-45b86ea5-0a96-4a9b-acf7-45b737e04ecf tempest-VolumesActionsTest-863745633 None] Detaching volume d3f9b759-803d-4a28-a2eb-ac75b45787f1 from instance fc603793-0b14-4b53-8ec2-5a9d084e4bc7. Sep 17 17:12:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-45b86ea5-0a96-4a9b-acf7-45b737e04ecf tempest-VolumesActionsTest-863745633 None] Detach volume completed successfully. Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45b86ea5-0a96-4a9b-acf7-45b737e04ecf tempest-VolumesActionsTest-863745633 None] Lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Flow 'volume_create_manager' (9aafc961-8f23-45cf-9173-76d45507028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99e5d16-3a96-4a2c-9adb-3937e5ae9326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99e5d16-3a96-4a2c-9adb-3937e5ae9326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2077437832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d536e00d-3588-4623-b62a-39111cdd9307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19a3f7998241f8a804767427813e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:31Z,use_quota=True,user_id='e8d36c6ee429434088ba109989e3f316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07124c86-773b-472e-8ac6-a51e00265550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07124c86-773b-472e-8ac6-a51e00265550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de682f84-73e5-423d-b2a5-51201a95d07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de682f84-73e5-423d-b2a5-51201a95d07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd536e00d-3588-4623-b62a-39111cdd9307', 'volume_name': 'volume-d536e00d-3588-4623-b62a-39111cdd9307', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329dc54d-921d-4cba-a0b0-e0dc8f3af62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329dc54d-921d-4cba-a0b0-e0dc8f3af62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:31 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896bd734-4a95-405a-ace7-a7c583a950ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:31 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Volume d536e00d-3588-4623-b62a-39111cdd9307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d536e00d-3588-4623-b62a-39111cdd9307', 'volume_size': 1} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61 1073741824" returned: 0 in 1.091s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:31 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61 Sep 17 17:12:31 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Flow 'volume_create_manager' (226b556f-a5d2-4265-a550-8ac59673f43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250df251-217f-49f8-8c75-0ca03156289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250df251-217f-49f8-8c75-0ca03156289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-726684509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19a3f7998241f8a804767427813e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:32Z,use_quota=True,user_id='e8d36c6ee429434088ba109989e3f316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53237909-f2a8-4512-a1c4-2ae058b07ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53237909-f2a8-4512-a1c4-2ae058b07ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd84722c-5251-4081-b129-0979581b5e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd84722c-5251-4081-b129-0979581b5e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7', 'volume_name': 'volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b92044-bd29-422f-93e7-c36e06e84385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b92044-bd29-422f-93e7-c36e06e84385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62b1ced-f327-4378-95b1-0bdab53e2905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Volume 8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7', 'volume_size': 1} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:32 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61" returned: 0 in 0.596s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1441493587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea31069-2f9d-415d-b676-98179703e092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19a3f7998241f8a804767427813e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:31Z,use_quota=True,user_id='e8d36c6ee429434088ba109989e3f316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Creating volume eea31069-2f9d-415d-b676-98179703e092 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:32 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:32 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092 1073741824 Sep 17 17:12:32 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11a5e4b-646f-4c73-8c2e-17b5b680e93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a8b491-649c-4fc9-b480-23423aefbb61', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c923c87-bf64-4f31-a2fe-61345fec2e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Volume volume-d4a8b491-649c-4fc9-b480-23423aefbb61 (d4a8b491-649c-4fc9-b480-23423aefbb61): created successfully Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c923c87-bf64-4f31-a2fe-61345fec2e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Flow 'volume_create_manager' (3eca1da1-72b7-40a1-a259-50ff378c2f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Flow 'volume_create_manager' (12ab6f5a-c5f4-4e86-88f9-878bf926c537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c70cfa-ca77-42fd-b395-f179698e34f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e4e0a718-1e1a-4c89-b4d8-3732377b2db2 tempest-CreateVolumesFromImageTest-82942846 None] Created volume successfully. Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c70cfa-ca77-42fd-b395-f179698e34f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-613940664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e55698-e7a9-4f5d-a6a9-045565bbe41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19a3f7998241f8a804767427813e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:32Z,use_quota=True,user_id='e8d36c6ee429434088ba109989e3f316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52ee8fe-395c-4773-8d84-ac91161fa926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52ee8fe-395c-4773-8d84-ac91161fa926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741f0433-48fd-43c0-a820-7819a45c7d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741f0433-48fd-43c0-a820-7819a45c7d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e55698-e7a9-4f5d-a6a9-045565bbe41b', 'volume_name': 'volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c40c10-e732-448d-ab83-13fd7aaccf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c40c10-e732-448d-ab83-13fd7aaccf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa626b8f-b2c9-4bcd-8584-bc910e645d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:32 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Volume b3e55698-e7a9-4f5d-a6a9-045565bbe41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b', 'volume_size': 1} Sep 17 17:12:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:33 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092 1073741824" returned: 0 in 0.539s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:33 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092 Sep 17 17:12:33 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:33 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092" returned: 0 in 0.444s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.790s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2077437832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d536e00d-3588-4623-b62a-39111cdd9307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19a3f7998241f8a804767427813e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:31Z,use_quota=True,user_id='e8d36c6ee429434088ba109989e3f316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Creating volume d536e00d-3588-4623-b62a-39111cdd9307 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:33 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5dea51-f692-4ba7-ae3d-9c6067a32f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea31069-2f9d-415d-b676-98179703e092', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ac6800-e6a9-49ad-a9b3-ba288152b4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:33 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307 1073741824 Sep 17 17:12:33 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:33 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Volume volume-eea31069-2f9d-415d-b676-98179703e092 (eea31069-2f9d-415d-b676-98179703e092): created successfully Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ac6800-e6a9-49ad-a9b3-ba288152b4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Flow 'volume_create_manager' (339d4ed2-0fa2-491a-bb44-43415ca8d371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:33 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0318d7e2-8e09-46f6-9e39-dc667c6680fe tempest-CreateVolumesFromImageTest-82942846 None] Created volume successfully. Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Flow 'volume_create_manager' (4b69ec6c-f7e1-480f-8160-e5a01db5f72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:34 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384767c8-9228-4c76-b743-41cc43956332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307 1073741824" returned: 0 in 0.671s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384767c8-9228-4c76-b743-41cc43956332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1166966476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409922fa-31f0-4460-b76d-00eccc180bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ae5a7542324dce86e00fabd57b07a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:34Z,use_quota=True,user_id='02e99ed71a5046d39e0a3ff10ac1769e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa86e9f-30d9-49e2-90a4-acb6538fd2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa86e9f-30d9-49e2-90a4-acb6538fd2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54cb69c-7f47-436e-a254-8542d25754ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54cb69c-7f47-436e-a254-8542d25754ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409922fa-31f0-4460-b76d-00eccc180bc6', 'volume_name': 'volume-409922fa-31f0-4460-b76d-00eccc180bc6', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5891a15a-70a3-4bea-a74e-84ae9895da0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5891a15a-70a3-4bea-a74e-84ae9895da0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd81f300-65f0-4c01-bdf9-4e379fcf91bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:34 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Volume 409922fa-31f0-4460-b76d-00eccc180bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409922fa-31f0-4460-b76d-00eccc180bc6', 'volume_size': 1} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:34 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307 Sep 17 17:12:34 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:34 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307" returned: 0 in 0.291s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.460s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-726684509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19a3f7998241f8a804767427813e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:32Z,use_quota=True,user_id='e8d36c6ee429434088ba109989e3f316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Creating volume 8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:34 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896bd734-4a95-405a-ace7-a7c583a950ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d536e00d-3588-4623-b62a-39111cdd9307', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:34 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 1073741824 Sep 17 17:12:34 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c0c635-3fab-49da-ba67-f85a550c27f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:34 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Volume volume-d536e00d-3588-4623-b62a-39111cdd9307 (d536e00d-3588-4623-b62a-39111cdd9307): created successfully Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c0c635-3fab-49da-ba67-f85a550c27f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Flow 'volume_create_manager' (9aafc961-8f23-45cf-9173-76d45507028b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-28831d5d-d17e-4419-befd-8b2003d125d1 tempest-CreateVolumesFromImageTest-82942846 None] Created volume successfully. Sep 17 17:12:35 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 1073741824" returned: 0 in 0.526s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:35 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 Sep 17 17:12:35 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:35 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7" returned: 0 in 0.282s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.751s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-613940664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e55698-e7a9-4f5d-a6a9-045565bbe41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d19a3f7998241f8a804767427813e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:32Z,use_quota=True,user_id='e8d36c6ee429434088ba109989e3f316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Creating volume b3e55698-e7a9-4f5d-a6a9-045565bbe41b {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:35 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62b1ced-f327-4378-95b1-0bdab53e2905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:35 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b 1073741824 Sep 17 17:12:35 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e302735-919e-4fde-a91b-ea4ab67b5758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:35 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Volume volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 (8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7): created successfully Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e302735-919e-4fde-a91b-ea4ab67b5758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Flow 'volume_create_manager' (226b556f-a5d2-4265-a550-8ac59673f43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:35 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e14b7363-f130-4bad-aa6b-99c1fb4c93fe tempest-CreateVolumesFromImageTest-82942846 None] Created volume successfully. Sep 17 17:12:36 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b 1073741824" returned: 0 in 0.573s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:36 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b Sep 17 17:12:36 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:36 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b" returned: 0 in 0.288s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1166966476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409922fa-31f0-4460-b76d-00eccc180bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ae5a7542324dce86e00fabd57b07a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:34Z,use_quota=True,user_id='02e99ed71a5046d39e0a3ff10ac1769e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Creating volume 409922fa-31f0-4460-b76d-00eccc180bc6 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:36 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:36 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6 1073741824 Sep 17 17:12:36 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa626b8f-b2c9-4bcd-8584-bc910e645d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83df7bb0-e9fd-4e55-8a9b-9b0f5244ccea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:36 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Volume volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b (b3e55698-e7a9-4f5d-a6a9-045565bbe41b): created successfully Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83df7bb0-e9fd-4e55-8a9b-9b0f5244ccea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Flow 'volume_create_manager' (12ab6f5a-c5f4-4e86-88f9-878bf926c537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:36 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e5ae4491-1017-40c6-abbe-cf71e06cafc4 tempest-CreateVolumesFromImageTest-82942846 None] Created volume successfully. Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "cinder-b3e55698-e7a9-4f5d-a6a9-045565bbe41b-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-b3e55698-e7a9-4f5d-a6a9-045565bbe41b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Flow 'volume_create_manager' (ec9faa2c-3eae-42e0-83c0-a57126aa5aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:37 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f36fa9-d7cf-4df5-b6a0-c68414f14a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6 1073741824" returned: 0 in 0.628s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f36fa9-d7cf-4df5-b6a0-c68414f14a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2043816118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8672497-480c-43a2-aaa7-74ba57adb2c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954bddf5dd86475ba693b50f22441451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:37Z,use_quota=True,user_id='85f43315480b4ca3aac3e420b64c7470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895a9247-3d52-469b-92ef-73c82d219b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895a9247-3d52-469b-92ef-73c82d219b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfdc59e-cacb-44f7-88d5-e508e40e0be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfdc59e-cacb-44f7-88d5-e508e40e0be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8672497-480c-43a2-aaa7-74ba57adb2c8', 'volume_name': 'volume-d8672497-480c-43a2-aaa7-74ba57adb2c8', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88aa43ad-ba1a-4525-baea-d1adb75231bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88aa43ad-ba1a-4525-baea-d1adb75231bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551ddf79-dcec-45ef-8ed6-10a0d6c75bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:37 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Volume d8672497-480c-43a2-aaa7-74ba57adb2c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8672497-480c-43a2-aaa7-74ba57adb2c8', 'volume_size': 1} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "cinder-quobyte-b3e55698-e7a9-4f5d-a6a9-045565bbe41b" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-quobyte-b3e55698-e7a9-4f5d-a6a9-045565bbe41b" acquired by "delete_volume" :: waited 0.038s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:37 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6 Sep 17 17:12:37 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e27810b-9201-4800-a27f-bcdda1400c79]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:37 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b Sep 17 17:12:37 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:37 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6" returned: 0 in 0.289s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.363s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2043816118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8672497-480c-43a2-aaa7-74ba57adb2c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954bddf5dd86475ba693b50f22441451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:37Z,use_quota=True,user_id='85f43315480b4ca3aac3e420b64c7470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Creating volume d8672497-480c-43a2-aaa7-74ba57adb2c8 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:37 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd81f300-65f0-4c01-bdf9-4e379fcf91bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409922fa-31f0-4460-b76d-00eccc180bc6', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c364b58-d19c-48ef-99f5-67f46967d02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:37 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8 1073741824 Sep 17 17:12:37 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:37 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Volume volume-409922fa-31f0-4460-b76d-00eccc180bc6 (409922fa-31f0-4460-b76d-00eccc180bc6): created successfully Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c364b58-d19c-48ef-99f5-67f46967d02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Flow 'volume_create_manager' (4b69ec6c-f7e1-480f-8160-e5a01db5f72d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b9ded301-e3cf-4527-8471-9b562877cbb1 tempest-AttachVolumeTestJSON-117987046 None] Created volume successfully. Sep 17 17:12:37 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b" returned: 0 in 0.458s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:37 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b Sep 17 17:12:37 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:38 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b3e55698-e7a9-4f5d-a6a9-045565bbe41b" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-quobyte-b3e55698-e7a9-4f5d-a6a9-045565bbe41b" released by "delete_volume" :: held 0.781s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Created reservations ['a5728c3b-0c1e-4896-8c5e-4689cc91d430', 'b6640424-ff80-46da-ba47-371ae5d27b50', 'b06063ea-2fcd-4c2e-b047-1fd03a95e161', 'cff47c8b-9033-4a76-9c57-2ceeef1f6879'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:38 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8 1073741824" returned: 0 in 0.639s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:38 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8 Sep 17 17:12:38 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:38 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:38 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:38 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8" returned: 0 in 0.491s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551ddf79-dcec-45ef-8ed6-10a0d6c75bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8672497-480c-43a2-aaa7-74ba57adb2c8', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:38 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6c7ec9-1c8b-4382-9a99-78b71113781c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.462s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:38 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Deleted volume successfully. Sep 17 17:12:38 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Volume volume-d8672497-480c-43a2-aaa7-74ba57adb2c8 (d8672497-480c-43a2-aaa7-74ba57adb2c8): created successfully Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6c7ec9-1c8b-4382-9a99-78b71113781c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Flow 'volume_create_manager' (ec9faa2c-3eae-42e0-83c0-a57126aa5aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:38 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f0a6fb7e-3243-4b6c-93b0-155c3b7d2506 tempest-VolumesListTestJSON-1608800787 None] Created volume successfully. Sep 17 17:12:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7414e9b3-5ffb-4ae6-b3d8-3de92f6651c0 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-b3e55698-e7a9-4f5d-a6a9-045565bbe41b-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "cinder-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "cinder-quobyte-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-8fd57a7d-9643-49c1-aebb-132f73785a3b req-c8200ee4-1e26-4a48-9ba3-66097cd36690 tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-8fd57a7d-9643-49c1-aebb-132f73785a3b req-c8200ee4-1e26-4a48-9ba3-66097cd36690 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-quobyte-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-8fd57a7d-9643-49c1-aebb-132f73785a3b req-c8200ee4-1e26-4a48-9ba3-66097cd36690 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d7ff7f-7588-4719-935d-d38b7fad76de]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-8fd57a7d-9643-49c1-aebb-132f73785a3b req-c8200ee4-1e26-4a48-9ba3-66097cd36690 tempest-AttachVolumeTestJSON-117987046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-409922fa-31f0-4460-b76d-00eccc180bc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd599a8f-65d7-45bf-8544-49f175c12b90', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:12:39 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-8fd57a7d-9643-49c1-aebb-132f73785a3b req-c8200ee4-1e26-4a48-9ba3-66097cd36690 tempest-AttachVolumeTestJSON-117987046 None] attachment_update completed successfully. Sep 17 17:12:39 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 Sep 17 17:12:39 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Flow 'volume_create_manager' (675dc7d1-4bb5-42dc-822a-aa866a428075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8439a740-598b-4c6e-9d9f-6c7b392cd50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8439a740-598b-4c6e-9d9f-6c7b392cd50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-81008011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c55842-5d88-49cf-9df5-60b1b8b94958,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954bddf5dd86475ba693b50f22441451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:40Z,use_quota=True,user_id='85f43315480b4ca3aac3e420b64c7470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cce415a-1a8c-4ee4-b84d-45c664f1238b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cce415a-1a8c-4ee4-b84d-45c664f1238b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bfd8fd-f7e0-4b28-be9b-57b98089e8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bfd8fd-f7e0-4b28-be9b-57b98089e8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c55842-5d88-49cf-9df5-60b1b8b94958', 'volume_name': 'volume-e6c55842-5d88-49cf-9df5-60b1b8b94958', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158f4a4f-e9b2-446f-bb17-e75fcad95aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158f4a4f-e9b2-446f-bb17-e75fcad95aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97570bde-20c4-4eca-b40d-e6a0e1a07b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:40 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Volume e6c55842-5d88-49cf-9df5-60b1b8b94958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c55842-5d88-49cf-9df5-60b1b8b94958', 'volume_size': 1} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-81008011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c55842-5d88-49cf-9df5-60b1b8b94958,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954bddf5dd86475ba693b50f22441451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:40Z,use_quota=True,user_id='85f43315480b4ca3aac3e420b64c7470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Creating volume e6c55842-5d88-49cf-9df5-60b1b8b94958 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:40 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:40 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958 1073741824 Sep 17 17:12:40 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:40 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7" returned: 0 in 0.624s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:40 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7 Sep 17 17:12:40 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:40 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7" returned: 0 in 0.439s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-quobyte-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7" released by "delete_volume" :: held 1.117s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=123,cinder:INSERT=44,cinder:UPDATE=161,cinder:DELETE=12 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=123,cinder:INSERT=42,cinder:UPDATE=134,cinder:DELETE=14 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Created reservations ['273cb6a9-df72-42aa-9701-b64379b3ce9e', 'ea38a84e-5596-47a8-87ee-1267e439b6bc', 'db91e30e-0c5d-4fdb-82ea-7ce08c70a8b7', '3abd9980-9a4c-4491-a179-c5d34b53d0c8'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:40 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958 1073741824" returned: 0 in 0.722s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:40 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958 Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:40 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:40 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:40 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:41 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958" returned: 0 in 0.428s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97570bde-20c4-4eca-b40d-e6a0e1a07b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c55842-5d88-49cf-9df5-60b1b8b94958', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae87e836-e884-4191-96c7-09a8347743d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:41 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.434s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:41 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:41 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Volume volume-e6c55842-5d88-49cf-9df5-60b1b8b94958 (e6c55842-5d88-49cf-9df5-60b1b8b94958): created successfully Sep 17 17:12:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae87e836-e884-4191-96c7-09a8347743d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Flow 'volume_create_manager' (675dc7d1-4bb5-42dc-822a-aa866a428075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Deleted volume successfully. Sep 17 17:12:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e8f4ca5-371c-433c-a044-6868d75a57a6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-8e8d940f-29cb-4fc9-b11c-a92c38a1c0d7-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-536d0517-a0bd-40c0-8073-5fcb7b0d2199 tempest-VolumesListTestJSON-1608800787 None] Created volume successfully. Sep 17 17:12:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "cinder-d536e00d-3588-4623-b62a-39111cdd9307-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-d536e00d-3588-4623-b62a-39111cdd9307-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "cinder-quobyte-d536e00d-3588-4623-b62a-39111cdd9307" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-quobyte-d536e00d-3588-4623-b62a-39111cdd9307" acquired by "delete_volume" :: waited 0.060s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:42 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7720515-e98e-485f-a057-6cc8dbe83aa9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:42 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307 Sep 17 17:12:42 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:42 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307" returned: 0 in 0.546s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:42 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307 Sep 17 17:12:42 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Flow 'volume_create_manager' (9b48adff-2dea-42eb-a575-eac40e1bdb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31862c8b-db3f-41de-84cb-dec6c372a08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31862c8b-db3f-41de-84cb-dec6c372a08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-520046950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa750e0-bbed-4307-acdb-7d76999e6f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ae5a7542324dce86e00fabd57b07a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:43Z,use_quota=True,user_id='02e99ed71a5046d39e0a3ff10ac1769e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8409f0ad-a310-4665-8202-beb90cfa572b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8409f0ad-a310-4665-8202-beb90cfa572b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6150d1c5-51fe-44b5-8514-d406d197a50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6150d1c5-51fe-44b5-8514-d406d197a50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa750e0-bbed-4307-acdb-7d76999e6f3b', 'volume_name': 'volume-daa750e0-bbed-4307-acdb-7d76999e6f3b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7e3d1c-939e-4dc9-9f90-85abeee96e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7e3d1c-939e-4dc9-9f90-85abeee96e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760cf09e-447e-4245-b178-d1937c35b2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:43 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Volume daa750e0-bbed-4307-acdb-7d76999e6f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa750e0-bbed-4307-acdb-7d76999e6f3b', 'volume_size': 1} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-520046950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa750e0-bbed-4307-acdb-7d76999e6f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ae5a7542324dce86e00fabd57b07a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:43Z,use_quota=True,user_id='02e99ed71a5046d39e0a3ff10ac1769e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Creating volume daa750e0-bbed-4307-acdb-7d76999e6f3b {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:43 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:43 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d536e00d-3588-4623-b62a-39111cdd9307" returned: 0 in 0.534s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:43 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b 1073741824 Sep 17 17:12:43 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Flow 'volume_create_manager' (2693f965-a287-445a-8117-8db9b193304c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b55c043-29dc-4ada-bb17-1cb032e1b6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-quobyte-d536e00d-3588-4623-b62a-39111cdd9307" released by "delete_volume" :: held 1.240s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b55c043-29dc-4ada-bb17-1cb032e1b6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1666013394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731d6200-ce46-40d1-b054-9e4d0c471a0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954bddf5dd86475ba693b50f22441451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:43Z,use_quota=True,user_id='85f43315480b4ca3aac3e420b64c7470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ee3054-540d-44c5-a0db-d884082be4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ee3054-540d-44c5-a0db-d884082be4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415d5dd5-50df-4438-8d3e-d1f1b2653f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415d5dd5-50df-4438-8d3e-d1f1b2653f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731d6200-ce46-40d1-b054-9e4d0c471a0b', 'volume_name': 'volume-731d6200-ce46-40d1-b054-9e4d0c471a0b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128fb22b-58f6-4d20-b2f9-5d9b9fa407d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128fb22b-58f6-4d20-b2f9-5d9b9fa407d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5335ad-8c0e-44ed-98a3-44d7f20f849d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:43 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Volume 731d6200-ce46-40d1-b054-9e4d0c471a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731d6200-ce46-40d1-b054-9e4d0c471a0b', 'volume_size': 1} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Created reservations ['c3de4657-2876-4447-884a-fe7b1bcc7a92', 'b0f5e618-d79f-4652-a815-ae3b7981296d', '9df600b4-a026-4dd7-bbcf-6c997bb3f024', 'e872ab70-fdbf-44a9-b100-681c2f48fffe'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:43 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:43 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:43 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b 1073741824" returned: 0 in 0.540s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:43 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.315s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:43 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Deleted volume successfully. Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:43 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b Sep 17 17:12:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bfb99eba-fa76-4fd9-be44-e8ede64d6145 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-d536e00d-3588-4623-b62a-39111cdd9307-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:43 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:44 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b" returned: 0 in 0.264s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.716s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1666013394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731d6200-ce46-40d1-b054-9e4d0c471a0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954bddf5dd86475ba693b50f22441451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:43Z,use_quota=True,user_id='85f43315480b4ca3aac3e420b64c7470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Creating volume 731d6200-ce46-40d1-b054-9e4d0c471a0b {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:12:44 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760cf09e-447e-4245-b178-d1937c35b2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa750e0-bbed-4307-acdb-7d76999e6f3b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:44 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b 1073741824 Sep 17 17:12:44 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92abf2e0-a34f-46af-b9d6-f7febc38973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:44 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Volume volume-daa750e0-bbed-4307-acdb-7d76999e6f3b (daa750e0-bbed-4307-acdb-7d76999e6f3b): created successfully Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92abf2e0-a34f-46af-b9d6-f7febc38973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Flow 'volume_create_manager' (9b48adff-2dea-42eb-a575-eac40e1bdb4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4a3da007-cfc2-4eb1-81cf-a285e676ce9e tempest-AttachVolumeTestJSON-117987046 None] Created volume successfully. Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "cinder-eea31069-2f9d-415d-b676-98179703e092-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-eea31069-2f9d-415d-b676-98179703e092-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "cinder-quobyte-eea31069-2f9d-415d-b676-98179703e092" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-quobyte-eea31069-2f9d-415d-b676-98179703e092" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d8ca2-df05-4ded-88ef-0269cdfc3d3a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:44 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092 Sep 17 17:12:44 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:44 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b 1073741824" returned: 0 in 0.607s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afb2ce4c-0c4a-4d17-bef5-d04e61c4f592 tempest-VolumesActionsTest-863745633 None] Acquiring lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1" by "attach_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afb2ce4c-0c4a-4d17-bef5-d04e61c4f592 tempest-VolumesActionsTest-863745633 None] Lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1" acquired by "attach_volume" :: waited 0.040s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:45 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b Sep 17 17:12:45 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-afb2ce4c-0c4a-4d17-bef5-d04e61c4f592 tempest-VolumesActionsTest-863745633 None] Attaching volume d3f9b759-803d-4a28-a2eb-ac75b45787f1 to instance 5153058f-59ec-4b8d-9357-907168f35225 at mountpoint /dev/vdb on host None. Sep 17 17:12:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-afb2ce4c-0c4a-4d17-bef5-d04e61c4f592 tempest-VolumesActionsTest-863745633 None] Attach volume completed successfully. Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afb2ce4c-0c4a-4d17-bef5-d04e61c4f592 tempest-VolumesActionsTest-863745633 None] Lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1" released by "attach_volume" :: held 0.207s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:45 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092" returned: 0 in 0.605s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:45 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092 Sep 17 17:12:45 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:45 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b" returned: 0 in 0.490s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5335ad-8c0e-44ed-98a3-44d7f20f849d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731d6200-ce46-40d1-b054-9e4d0c471a0b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d728e4-05fe-4488-86d7-09f8cc45e607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:45 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Volume volume-731d6200-ce46-40d1-b054-9e4d0c471a0b (731d6200-ce46-40d1-b054-9e4d0c471a0b): created successfully Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d728e4-05fe-4488-86d7-09f8cc45e607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Flow 'volume_create_manager' (2693f965-a287-445a-8117-8db9b193304c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ccf69470-a29d-4668-9c71-e50cf78bd66c tempest-VolumesListTestJSON-1608800787 None] Created volume successfully. Sep 17 17:12:45 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eea31069-2f9d-415d-b676-98179703e092" returned: 0 in 0.472s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-quobyte-eea31069-2f9d-415d-b676-98179703e092" released by "delete_volume" :: held 1.149s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-74269470-2ddf-45da-81dd-4400add29b6c tempest-VolumesActionsTest-863745633 None] Acquiring lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1-detach_volume" by "detach_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-74269470-2ddf-45da-81dd-4400add29b6c tempest-VolumesActionsTest-863745633 None] Lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-74269470-2ddf-45da-81dd-4400add29b6c tempest-VolumesActionsTest-863745633 None] Detaching volume d3f9b759-803d-4a28-a2eb-ac75b45787f1 from instance 5153058f-59ec-4b8d-9357-907168f35225. Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Created reservations ['bc88876a-f9f9-4b4f-a140-466a92fabb57', '2f0db213-0f03-49b6-bef5-cf66cfe1e716', 'd5db762d-01d3-493e-82a6-6c82ba55050e', '6f75471a-f0e3-4234-8931-63136fd314c0'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-74269470-2ddf-45da-81dd-4400add29b6c tempest-VolumesActionsTest-863745633 None] Detach volume completed successfully. Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-74269470-2ddf-45da-81dd-4400add29b6c tempest-VolumesActionsTest-863745633 None] Lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:46 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:46 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-a2f54550-279e-465e-a6a9-a02657add17e req-5c87bf7f-695c-4eeb-8523-20b96f01aa66 tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-a2f54550-279e-465e-a6a9-a02657add17e req-5c87bf7f-695c-4eeb-8523-20b96f01aa66 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-a2f54550-279e-465e-a6a9-a02657add17e req-5c87bf7f-695c-4eeb-8523-20b96f01aa66 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-a2f54550-279e-465e-a6a9-a02657add17e req-5c87bf7f-695c-4eeb-8523-20b96f01aa66 tempest-AttachVolumeTestJSON-117987046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-daa750e0-bbed-4307-acdb-7d76999e6f3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd538010c-6d20-481b-8718-d4bb1de19e51', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:12:46 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.374s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:46 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Deleted volume successfully. Sep 17 17:12:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-a2f54550-279e-465e-a6a9-a02657add17e req-5c87bf7f-695c-4eeb-8523-20b96f01aa66 tempest-AttachVolumeTestJSON-117987046 None] attachment_update completed successfully. Sep 17 17:12:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3596dd51-d414-48b0-99dd-c27327d3254e tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-eea31069-2f9d-415d-b676-98179703e092-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "cinder-d4a8b491-649c-4fc9-b480-23423aefbb61-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-d4a8b491-649c-4fc9-b480-23423aefbb61-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "cinder-quobyte-d4a8b491-649c-4fc9-b480-23423aefbb61" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-quobyte-d4a8b491-649c-4fc9-b480-23423aefbb61" acquired by "delete_volume" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:47 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bdd60f-7b0b-4e10-9ec0-250d4eb3ccaa]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:47 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61 Sep 17 17:12:47 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:47 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61" returned: 0 in 0.574s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:47 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61 Sep 17 17:12:47 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:48 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d4a8b491-649c-4fc9-b480-23423aefbb61" returned: 0 in 0.446s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-quobyte-d4a8b491-649c-4fc9-b480-23423aefbb61" released by "delete_volume" :: held 1.095s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Created reservations ['0c2ce6d4-c5fc-46ed-92b4-9bae0d4971b0', '8029d0f3-7d3e-4e45-8fb0-3d5c92552cf3', 'd6026464-8cdc-4869-b3e4-c4862959d4ff', 'a08fd785-6c4b-4385-8b89-921be6490f5e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:48 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:48 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:48 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.277s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:48 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Deleted volume successfully. Sep 17 17:12:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bd568266-95de-454e-b606-97ec737803f6 tempest-CreateVolumesFromImageTest-82942846 None] Lock "cinder-d4a8b491-649c-4fc9-b480-23423aefbb61-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:49 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-3362c382-0b55-415d-bff3-468f829c7257 req-5decc7bb-183f-4498-a2af-1681fd5101d8 tempest-AttachVolumeTestJSON-117987046 None] Terminate volume connection completed successfully. Sep 17 17:12:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-3362c382-0b55-415d-bff3-468f829c7257 req-5decc7bb-183f-4498-a2af-1681fd5101d8 tempest-AttachVolumeTestJSON-117987046 None] Deleting attachment fd599a8f-65d7-45bf-8544-49f175c12b90. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:12:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "cinder-731d6200-ce46-40d1-b054-9e4d0c471a0b-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-731d6200-ce46-40d1-b054-9e4d0c471a0b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "cinder-quobyte-731d6200-ce46-40d1-b054-9e4d0c471a0b" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-quobyte-731d6200-ce46-40d1-b054-9e4d0c471a0b" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:50 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ead21a-b450-4874-9f3b-56e572658e58]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:50 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b Sep 17 17:12:50 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:50 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b" returned: 0 in 0.567s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:50 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b Sep 17 17:12:50 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:51 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-731d6200-ce46-40d1-b054-9e4d0c471a0b" returned: 0 in 0.310s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-quobyte-731d6200-ce46-40d1-b054-9e4d0c471a0b" released by "delete_volume" :: held 0.953s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-aea5068e-899e-4edc-9fa2-dd1a69bb3df7 req-9f96c1ee-f124-494d-9c11-b8f627ab15a1 tempest-AttachVolumeTestJSON-117987046 None] Terminate volume connection completed successfully. Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-aea5068e-899e-4edc-9fa2-dd1a69bb3df7 req-9f96c1ee-f124-494d-9c11-b8f627ab15a1 tempest-AttachVolumeTestJSON-117987046 None] Deleting attachment d538010c-6d20-481b-8718-d4bb1de19e51. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Created reservations ['cbdd66fd-e059-4004-aa69-1100b0cdcec2', '196c4b51-211c-4747-94f3-c388d1351368', '572e18ff-2a60-4600-9b2c-e4e82139da71', 'b390b7ba-c075-46ec-958a-8ee7bdc25c1c'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:51 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:51 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "cinder-e6c55842-5d88-49cf-9df5-60b1b8b94958-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-e6c55842-5d88-49cf-9df5-60b1b8b94958-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c256f520-1ba5-4dd8-9634-88dc57f61dfc]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "cinder-quobyte-e6c55842-5d88-49cf-9df5-60b1b8b94958" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-quobyte-e6c55842-5d88-49cf-9df5-60b1b8b94958" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:51 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.338s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Deleted volume successfully. Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[545ae55f-391f-47e5-bbe9-d0762628758b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3e6c48a1-5f5d-451a-98f4-1cef06499cfe tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-731d6200-ce46-40d1-b054-9e4d0c471a0b-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:51 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 Sep 17 17:12:51 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:51 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958 Sep 17 17:12:51 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:52 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1" returned: 0 in 0.507s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[738b983f-6ece-42b1-8734-b77258ce0b37]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:52 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958" returned: 0 in 0.506s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:52 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 Sep 17 17:12:52 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:52 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958 Sep 17 17:12:52 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:52 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e6c55842-5d88-49cf-9df5-60b1b8b94958" returned: 0 in 0.345s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-quobyte-e6c55842-5d88-49cf-9df5-60b1b8b94958" released by "delete_volume" :: held 0.917s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:52 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1" returned: 0 in 0.488s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.ecdcc9cd-e136-4d21-a74a-02db6d347dean8cf3rsm.img {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:52 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.ecdcc9cd-e136-4d21-a74a-02db6d347dean8cf3rsm.img Sep 17 17:12:52 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Created reservations ['cd7c3c73-abfd-4aae-a0b7-0fa959b78039', '833d393b-9d53-4508-8846-7d16f3af62e8', '404e8b0f-5443-4282-9796-2e9adc965c80', 'd81fddcc-2750-4cec-9264-77042199657e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:52 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:52 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:53 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.606s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:53 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:53 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Deleted volume successfully. Sep 17 17:12:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-85cabd64-acf5-4d9d-91b2-1fc7854001db tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-e6c55842-5d88-49cf-9df5-60b1b8b94958-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (437c61b6-1dfe-4d42-8405-ec94782eb9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7b7b61-f09e-4407-af14-e749bbe0bd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7b7b61-f09e-4407-af14-e749bbe0bd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1035513280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:54Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3417f1fe-8ce7-4031-b5d4-c52bcf9c3d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3417f1fe-8ce7-4031-b5d4-c52bcf9c3d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c112d42-bb5f-4607-9643-0663059687eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c112d42-bb5f-4607-9643-0663059687eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4', 'volume_name': 'volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53c8978-bf31-4aef-a99c-b34e193e3584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53c8978-bf31-4aef-a99c-b34e193e3584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4409c26-36dc-484a-af0b-49a7d4e35507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:12:54 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4', 'volume_size': 1} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "cinder-d8672497-480c-43a2-aaa7-74ba57adb2c8-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-d8672497-480c-43a2-aaa7-74ba57adb2c8-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "cinder-quobyte-d8672497-480c-43a2-aaa7-74ba57adb2c8" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-quobyte-d8672497-480c-43a2-aaa7-74ba57adb2c8" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[742da633-e9fc-46f1-a704-6bd4f1fa40f0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:54 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8 Sep 17 17:12:54 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:55 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8" returned: 0 in 0.752s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:55 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8 Sep 17 17:12:55 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:55 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d8672497-480c-43a2-aaa7-74ba57adb2c8" returned: 0 in 0.641s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-quobyte-d8672497-480c-43a2-aaa7-74ba57adb2c8" released by "delete_volume" :: held 1.502s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:56 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Created reservations ['f559a3d0-6157-4ce6-8267-2d81ab4bb130', '10d2bf05-76cc-40af-8f43-53dc6c152d01', 'fbb003eb-f632-4fe3-a55e-c32d84065bdc', 'ce196bbf-2c37-45e8-8a7a-f53223cb3243'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:12:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:12:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:12:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:12:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:12:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:12:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:56 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:12:56 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:12:56 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 17 17:12:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.370s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:12:56 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:12:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Deleted volume successfully. Sep 17 17:12:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69530f26-4331-48e1-9328-8f80217aa9a9 tempest-VolumesListTestJSON-1608800787 None] Lock "cinder-d8672497-480c-43a2-aaa7-74ba57adb2c8-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:12:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "cinder-daa750e0-bbed-4307-acdb-7d76999e6f3b-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-daa750e0-bbed-4307-acdb-7d76999e6f3b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "cinder-quobyte-daa750e0-bbed-4307-acdb-7d76999e6f3b" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:12:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-quobyte-daa750e0-bbed-4307-acdb-7d76999e6f3b" acquired by "delete_volume" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:12:59 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f4076c-a298-49c3-9004-309e5a616f1e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:12:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:12:59 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b Sep 17 17:12:59 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:00 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b" returned: 0 in 0.716s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:00 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b Sep 17 17:13:00 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:00 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa750e0-bbed-4307-acdb-7d76999e6f3b" returned: 0 in 0.466s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-quobyte-daa750e0-bbed-4307-acdb-7d76999e6f3b" released by "delete_volume" :: held 1.275s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Created reservations ['b895b37d-c8a4-4869-b732-eb24e3b02459', '9a0f38bf-3344-4ba8-8d34-16efc18fb0ff', 'daa5dff0-eab1-41ed-a3a7-71870185bc22', '431799f3-b960-4704-9796-e7a072a5edcc'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:01 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.ecdcc9cd-e136-4d21-a74a-02db6d347dean8cf3rsm.img" returned: 0 in 8.570s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9894e83-8d96-4816-af17-61c0e3178c5b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:01 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:01 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:01 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 Sep 17 17:13:01 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:01 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.274s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:01 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Deleted volume successfully. Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-985b2f7d-0a40-404f-a33e-9dbe843a89bd tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-daa750e0-bbed-4307-acdb-7d76999e6f3b-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:01 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1" returned: 0 in 0.585s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.ecdcc9cd-e136-4d21-a74a-02db6d347dean8cf3rsm.img {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:13:01 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Converted 1024.00 MB image at 119.47 MB/s Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] ecdcc9cd-e136-4d21-a74a-02db6d347dea was raw, no need to convert to raw {{(pid=85889) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "cinder-409922fa-31f0-4460-b76d-00eccc180bc6-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-409922fa-31f0-4460-b76d-00eccc180bc6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "cinder-quobyte-409922fa-31f0-4460-b76d-00eccc180bc6" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-quobyte-409922fa-31f0-4460-b76d-00eccc180bc6" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6328176-2767-40be-b953-da995fce18a7]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:02 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6 Sep 17 17:13:02 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:02 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6" returned: 0 in 0.406s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:02 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6 Sep 17 17:13:02 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:02 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-409922fa-31f0-4460-b76d-00eccc180bc6" returned: 0 in 0.313s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-quobyte-409922fa-31f0-4460-b76d-00eccc180bc6" released by "delete_volume" :: held 0.787s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Flow 'volume_create_manager' (056ba869-9c73-4232-921a-a3d0df18e386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c336660-21f9-4034-93b5-8577f6796646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c336660-21f9-4034-93b5-8577f6796646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-359886805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fe356f-bee5-48a2-8f86-eebd2e159617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb11790c5ea43798da0f3edf2ef2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:03Z,use_quota=True,user_id='a1ed94e72cdc4a4fa1d6b9586c75bd4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2b7eeb-b3d4-4fe9-bba8-98d9ae7fb385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2b7eeb-b3d4-4fe9-bba8-98d9ae7fb385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef509950-f8ec-4153-8d4e-d60f73aebc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef509950-f8ec-4153-8d4e-d60f73aebc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44fe356f-bee5-48a2-8f86-eebd2e159617', 'volume_name': 'volume-44fe356f-bee5-48a2-8f86-eebd2e159617', 'volume_size': 2}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23e0709-2667-4526-a4f5-8a4c3cbf5363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23e0709-2667-4526-a4f5-8a4c3cbf5363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ded55b-69dc-40bb-9537-7250c2f84183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:02 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Volume 44fe356f-bee5-48a2-8f86-eebd2e159617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44fe356f-bee5-48a2-8f86-eebd2e159617', 'volume_size': 2} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:02 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Created reservations ['3f306909-234b-44f4-869f-5d66d620e561', '700a1e80-f937-49cd-bf60-f22388a402b6', 'c6fff727-a7d1-476d-bbc5-a379a85cee68', '0ae7e306-cc97-4494-8d94-0dc1896f3703'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:03 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:03 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "cinder-4b412a3c-d328-4c64-9306-4e72c38ff0ff-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-4b412a3c-d328-4c64-9306-4e72c38ff0ff-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "cinder-quobyte-4b412a3c-d328-4c64-9306-4e72c38ff0ff" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:03 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-quobyte-4b412a3c-d328-4c64-9306-4e72c38ff0ff" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.336s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:03 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Deleted volume successfully. Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8de950-d043-409e-bc6e-b2cda2b54187]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b6204f21-f500-444d-acba-adbe77e0cb3e tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-409922fa-31f0-4460-b76d-00eccc180bc6-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:03 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff Sep 17 17:13:03 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:03 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff" returned: 0 in 0.445s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:03 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff Sep 17 17:13:03 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:04 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4b412a3c-d328-4c64-9306-4e72c38ff0ff" returned: 0 in 0.271s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-quobyte-4b412a3c-d328-4c64-9306-4e72c38ff0ff" released by "delete_volume" :: held 0.782s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Created reservations ['ec515fdd-6b7c-4e4c-8499-ae0dc8930743', '862ef037-079b-4656-864c-ea5544ed026a', 'd0fdb9ac-c3ba-4a27-badf-14a842c69a7e', '6b0c49ca-09df-4767-81df-c20c54ce2c31'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:04 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:04 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:04 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.292s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Deleted volume successfully. Sep 17 17:13:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1704aa8b-ca37-4527-9ddf-182f85bd56e7 tempest-AttachVolumeTestJSON-117987046 None] Lock "cinder-4b412a3c-d328-4c64-9306-4e72c38ff0ff-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Flow 'volume_create_manager' (0d4e8dba-331a-4bfa-81b9-77a54494fab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2c3d4b-aec7-44c4-b61c-dbbf35d95301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2c3d4b-aec7-44c4-b61c-dbbf35d95301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-620670546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fd5906-9d61-46ba-84a6-97df9c3a8858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7521d87d98444f3b5f97ec96fc4956c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:13Z,use_quota=True,user_id='8e920bd2ac3941e4b8d786b9ae35023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e148c4-622d-4ac6-a11d-79e799bc98f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e148c4-622d-4ac6-a11d-79e799bc98f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbacaaa9-b9e4-4144-9fde-1ecf28932f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbacaaa9-b9e4-4144-9fde-1ecf28932f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3fd5906-9d61-46ba-84a6-97df9c3a8858', 'volume_name': 'volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df11ba4-abcd-4298-ac4b-1b39e62152fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df11ba4-abcd-4298-ac4b-1b39e62152fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f0e25a-6bdf-4ba7-bcf3-3ce1e22c1354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:12 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Volume e3fd5906-9d61-46ba-84a6-97df9c3a8858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858', 'volume_size': 1} Sep 17 17:13:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.576s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Uploaded volume to glance image-id: ecdcc9cd-e136-4d21-a74a-02db6d347dea. {{(pid=85889) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.921s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1035513280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:12:54Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Creating volume e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:13:22 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:22 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 1073741824 Sep 17 17:13:22 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:22 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c290dcc7-e8b6-46a2-8831-1cd9b9902035 tempest-VolumesActionsTest-863745633 None] Copy volume to image completed successfully. Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:22 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:22 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:22 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 1073741824" returned: 0 in 0.445s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:22 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.274s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:13:22 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 Sep 17 17:13:22 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:22 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.913s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-359886805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fe356f-bee5-48a2-8f86-eebd2e159617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb11790c5ea43798da0f3edf2ef2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:03Z,use_quota=True,user_id='a1ed94e72cdc4a4fa1d6b9586c75bd4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Creating volume 44fe356f-bee5-48a2-8f86-eebd2e159617 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:13:22 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 2147483648 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4409c26-36dc-484a-af0b-49a7d4e35507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:22 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 2147483648 Sep 17 17:13:22 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21059315-0af4-456c-bcef-a3a1d24a37cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:22 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 (e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4): created successfully Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21059315-0af4-456c-bcef-a3a1d24a37cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (437c61b6-1dfe-4d42-8405-ec94782eb9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:22 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-660ec4fb-fa83-4559-b469-154ece52e59f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created volume successfully. Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:23 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 2147483648" returned: 0 in 0.628s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:23 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 Sep 17 17:13:23 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:23 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617" returned: 0 in 0.258s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.995s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-620670546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fd5906-9d61-46ba-84a6-97df9c3a8858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7521d87d98444f3b5f97ec96fc4956c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:13Z,use_quota=True,user_id='8e920bd2ac3941e4b8d786b9ae35023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Creating volume e3fd5906-9d61-46ba-84a6-97df9c3a8858 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:13:23 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ded55b-69dc-40bb-9537-7250c2f84183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44fe356f-bee5-48a2-8f86-eebd2e159617', 'volume_size': 2}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:23 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 1073741824 Sep 17 17:13:23 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f90919c-6058-4861-a7c8-19ecd8ce12ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:23 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Volume volume-44fe356f-bee5-48a2-8f86-eebd2e159617 (44fe356f-bee5-48a2-8f86-eebd2e159617): created successfully Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f90919c-6058-4861-a7c8-19ecd8ce12ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Flow 'volume_create_manager' (056ba869-9c73-4232-921a-a3d0df18e386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:23 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-64c719f9-0249-42bb-a994-8352755417ec tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Created volume successfully. Sep 17 17:13:24 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 1073741824" returned: 0 in 0.414s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:24 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 Sep 17 17:13:24 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:24 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.105s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f0e25a-6bdf-4ba7-bcf3-3ce1e22c1354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55e19af-c2df-4502-953d-ba9c5d52aa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Creating offline snapshot cce16d3e-180a-4a4d-b9a7-b9974a24bc16 of volume e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:13:24 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Volume volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 (e3fd5906-9d61-46ba-84a6-97df9c3a8858): created successfully Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55e19af-c2df-4502-953d-ba9c5d52aa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Flow 'volume_create_manager' (0d4e8dba-331a-4bfa-81b9-77a54494fab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c681c3-3e4f-4e0a-926f-0b41e5930707]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:24 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-f085488f-467f-4804-ad7b-b8f22f33485e req-413ce11c-e3fc-4d78-b709-cee2779dddf2 tempest-VolumesSnapshotsTestJSON-1538710784 None] Created volume successfully. Sep 17 17:13:24 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 Sep 17 17:13:24 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:24 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" returned: 0 in 0.394s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:25 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 1G Sep 17 17:13:25 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:25 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 1G" returned: 0 in 0.399s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:25 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 Sep 17 17:13:25 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:25 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16" returned: 0 in 0.309s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:25 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 is being set with open permissions: ugo+rw Sep 17 17:13:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:25 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 Sep 17 17:13:25 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:25 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16" returned: 0 in 0.266s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:26 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.info Sep 17 17:13:26 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:26 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.info" returned: 0 in 0.258s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:26 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.info is being set with open permissions: ugo+rw Sep 17 17:13:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:26 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.info Sep 17 17:13:26 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:26 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.info" returned: 0 in 0.247s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.760s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:26 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[592f5b1d-64c4-499d-beb5-488c79dadb69]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:26 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d6b60ec7-09c8-4a44-9f06-f175c48735ba tempest-CreateVolumesFromSnapshotTest-1899045236 None] Create snapshot completed successfully Sep 17 17:13:26 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 Sep 17 17:13:26 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:26 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1" returned: 0 in 0.380s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:26 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cef174-6256-4f07-a815-4ee5bbf4b59e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:27 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 Sep 17 17:13:27 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:27 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1" returned: 0 in 0.366s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:27 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img Sep 17 17:13:27 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (932b96f1-1068-41c3-b92e-cd7a83e42fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67956269-faa6-4159-a0b7-86878c410dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67956269-faa6-4159-a0b7-86878c410dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1837784732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b328961d-1f96-45ee-a0aa-ba6e7c3bf76b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:28Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6486ca30-907c-4147-b42f-8253291dd46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6486ca30-907c-4147-b42f-8253291dd46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af1b2fa-25aa-4dc0-a373-8a1e626e3657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af1b2fa-25aa-4dc0-a373-8a1e626e3657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b328961d-1f96-45ee-a0aa-ba6e7c3bf76b', 'volume_name': 'volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84c5e43-603c-4014-b924-cb211de582e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84c5e43-603c-4014-b924-cb211de582e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a3d91c-8b0d-4b48-81b7-51c19baa19a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:28 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume b328961d-1f96-45ee-a0aa-ba6e7c3bf76b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b', 'volume_size': 1} Sep 17 17:13:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (29a0edee-3232-418b-99af-8b6b2ebd33c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c7984f-03fa-40f4-a621-036caf6e9823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c7984f-03fa-40f4-a621-036caf6e9823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586418410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094522b4-0fa9-4f90-905b-f9e3a423e53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:29Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e6783b-296d-4d66-b220-f5aa385d52ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e6783b-296d-4d66-b220-f5aa385d52ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f566230d-765e-4d60-95fb-76f33673d052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f566230d-765e-4d60-95fb-76f33673d052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094522b4-0fa9-4f90-905b-f9e3a423e53d', 'volume_name': 'volume-094522b4-0fa9-4f90-905b-f9e3a423e53d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3529c395-a90e-4ff3-a1e2-7ff812ed6854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3529c395-a90e-4ff3-a1e2-7ff812ed6854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7eed97d-d57b-4b15-88e2-37f80c709769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:29 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume 094522b4-0fa9-4f90-905b-f9e3a423e53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094522b4-0fa9-4f90-905b-f9e3a423e53d', 'volume_size': 1} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (06df7da9-d309-4d5d-a3d1-5e12ff2d162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8886f93-e2c2-400e-8c83-2bacca1e5607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8886f93-e2c2-400e-8c83-2bacca1e5607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075678447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1e73b1-34d1-491a-915b-fcbd93d3ba94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:30Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a885e3a9-9144-4f60-af91-69918b9c88ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a885e3a9-9144-4f60-af91-69918b9c88ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66dc8bb3-3474-463a-a2fc-a5e83a08d73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66dc8bb3-3474-463a-a2fc-a5e83a08d73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1e73b1-34d1-491a-915b-fcbd93d3ba94', 'volume_name': 'volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd46655-ee39-4beb-a0cd-256f22b08fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd46655-ee39-4beb-a0cd-256f22b08fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3a72a4-f2bf-4a15-a486-3f7509e2dc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume 4a1e73b1-34d1-491a-915b-fcbd93d3ba94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94', 'volume_size': 1} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (b9991b49-5afc-466c-83fe-064b95761b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bd962a-a2ec-45a5-8914-c0ba5ad76103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bd962a-a2ec-45a5-8914-c0ba5ad76103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2077758725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c249b0e7-7ff6-43c4-8720-eff2a20b83a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:30Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea804c4-1bfb-40e1-876d-9e0ae0afef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea804c4-1bfb-40e1-876d-9e0ae0afef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6736cc-a39a-4b2e-b879-462624468d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6736cc-a39a-4b2e-b879-462624468d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c249b0e7-7ff6-43c4-8720-eff2a20b83a5', 'volume_name': 'volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff54ef3-bdf1-49b7-9083-8f881aa601f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff54ef3-bdf1-49b7-9083-8f881aa601f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6faa4f-dbfc-4ef6-b28a-b4686deb56e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume c249b0e7-7ff6-43c4-8720-eff2a20b83a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5', 'volume_size': 1} Sep 17 17:13:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (001f7220-f94f-40a8-b460-ea49f33b380e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dea322-00f1-49dd-9aa8-471da99ab4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dea322-00f1-49dd-9aa8-471da99ab4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-599782204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6596bf3a-854f-42b8-af48-8ae82150d902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:31Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc76065-8eed-40b0-bd19-5a70405cecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc76065-8eed-40b0-bd19-5a70405cecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4af5cd-d30a-4744-867e-e0f40a4bd2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4af5cd-d30a-4744-867e-e0f40a4bd2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6596bf3a-854f-42b8-af48-8ae82150d902', 'volume_name': 'volume-6596bf3a-854f-42b8-af48-8ae82150d902', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db906a04-604a-4f50-85f6-afbf65adcb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db906a04-604a-4f50-85f6-afbf65adcb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d956212-4d48-4524-8ef4-dfffaa03a487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:31 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume 6596bf3a-854f-42b8-af48-8ae82150d902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6596bf3a-854f-42b8-af48-8ae82150d902', 'volume_size': 1} Sep 17 17:13:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:34 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img" returned: 0 in 7.031s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:34 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ee0eaf-0247-4bb7-a93a-ff5f5135a094]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:34 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 Sep 17 17:13:34 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:34 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1" returned: 0 in 0.537s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:34 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:13:34 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Converted 1024.00 MB image at 145.63 MB/s Sep 17 17:13:34 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] c6bc7346-7624-437a-af7b-a5e6ecc00a14 was raw, converting to qcow2 {{(pid=85889) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 17 17:13:34 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[92575a6f-c9ba-403d-affd-aa9bbe204bbe]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:35 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img Sep 17 17:13:35 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:35 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img" returned: 0 in 0.317s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:35 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img Sep 17 17:13:35 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:35 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img" returned: 1 in 0.323s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:13:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img /opt/stack/data/cinder/conversion/vol_upload_30uren54 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:35 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img /opt/stack/data/cinder/conversion/vol_upload_30uren54 Sep 17 17:13:35 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:35 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img /opt/stack/data/cinder/conversion/vol_upload_30uren54" returned: 0 in 0.254s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:35 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Image conversion details: src /opt/stack/data/cinder/conversion/d3f9b759-803d-4a28-a2eb-ac75b45787f1.temp_image.c6bc7346-7624-437a-af7b-a5e6ecc00a14_hx57cmk.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_30uren54 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:13:35 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 17 17:13:35 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1b7b93-2a9e-4940-8f69-c57acd1da153]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_30uren54 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:35 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_30uren54 Sep 17 17:13:35 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:36 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_30uren54" returned: 0 in 0.381s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.958s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Uploaded volume to glance image-id: c6bc7346-7624-437a-af7b-a5e6ecc00a14. {{(pid=85889) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 17:13:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.738s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Creating offline snapshot 14c11ece-6270-4f71-adbc-743377350d89 of volume 44fe356f-bee5-48a2-8f86-eebd2e159617 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:13:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-88b8d0f4-8b4d-4fb6-b92e-414e16c910da tempest-VolumesActionsTest-863745633 None] Copy volume to image completed successfully. Sep 17 17:13:37 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[78539651-34d8-49dc-a0c2-e9df25b1fcf2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:37 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 Sep 17 17:13:37 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:37 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617" returned: 0 in 0.351s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 2G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:37 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 2G Sep 17 17:13:37 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:38 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 2G" returned: 0 in 0.392s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44fe356f-bee5-48a2-8f86-eebd2e159617 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:38 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44fe356f-bee5-48a2-8f86-eebd2e159617 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 Sep 17 17:13:38 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:38 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44fe356f-bee5-48a2-8f86-eebd2e159617 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89" returned: 0 in 0.284s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:38 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 is being set with open permissions: ugo+rw Sep 17 17:13:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:38 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 Sep 17 17:13:38 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:38 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89" returned: 0 in 0.253s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:38 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.info Sep 17 17:13:38 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:39 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.info" returned: 0 in 0.276s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:39 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.info is being set with open permissions: ugo+rw Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:39 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.info Sep 17 17:13:39 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Acquiring lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Acquiring lock "cinder-quobyte-d3f9b759-803d-4a28-a2eb-ac75b45787f1" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Lock "cinder-quobyte-d3f9b759-803d-4a28-a2eb-ac75b45787f1" acquired by "delete_volume" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f53ef2-69b8-4342-8698-efbb764e6892]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:39 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.info" returned: 0 in 0.272s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.494s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Creating offline snapshot 9caf4051-fc0a-407a-929e-b3a4c32bea55 of volume e3fd5906-9d61-46ba-84a6-97df9c3a8858 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:13:39 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 Sep 17 17:13:39 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:39 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-faddd1a8-2223-49ed-800b-40eb411ee8fc tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Create snapshot completed successfully Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[069d4b8e-ca55-4fd8-bfe3-0bb7d33b25f8]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:39 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 Sep 17 17:13:39 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:39 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1" returned: 0 in 0.373s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:39 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1 Sep 17 17:13:39 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:39 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858" returned: 0 in 0.371s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:39 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 1G Sep 17 17:13:39 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:39 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3f9b759-803d-4a28-a2eb-ac75b45787f1" returned: 0 in 0.259s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Lock "cinder-quobyte-d3f9b759-803d-4a28-a2eb-ac75b45787f1" released by "delete_volume" :: held 0.689s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Created reservations ['6ec003ea-4c1d-47ab-a878-4f75e77cb06c', '76493eb3-5a6b-4f7c-9b3d-5efccc072377', '5138ca89-4af4-40bb-929e-b229666a7135', '935578e5-3672-4857-98f7-9a93e4a41310'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:40 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:40 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:40 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 1G" returned: 0 in 0.458s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:40 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 Sep 17 17:13:40 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:40 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.279s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Deleted volume successfully. Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-58b0497f-ab3a-42da-b207-e458a31e3e94 tempest-VolumesActionsTest-863745633 None] Lock "cinder-d3f9b759-803d-4a28-a2eb-ac75b45787f1-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:40 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55" returned: 0 in 0.358s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:40 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 is being set with open permissions: ugo+rw Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Acquiring lock "cinder-14c11ece-6270-4f71-adbc-743377350d89-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:40 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 Sep 17 17:13:40 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "cinder-14c11ece-6270-4f71-adbc-743377350d89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Acquiring lock "cinder-quobyte-44fe356f-bee5-48a2-8f86-eebd2e159617" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "cinder-quobyte-44fe356f-bee5-48a2-8f86-eebd2e159617" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Acquiring lock "cinder-quobyte-14c11ece-6270-4f71-adbc-743377350d89" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "cinder-quobyte-14c11ece-6270-4f71-adbc-743377350d89" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Deleting offline snapshot 14c11ece-6270-4f71-adbc-743377350d89 of volume 44fe356f-bee5-48a2-8f86-eebd2e159617 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] snapshot_file for this snap is: volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b8e317-5985-42ce-938d-6c01dc5b54cb]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:40 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 Sep 17 17:13:40 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:40 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55" returned: 0 in 0.286s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:INSERT=24,cinder:UPDATE=119,cinder:SELECT=93,cinder:DELETE=11 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=102,cinder:INSERT=30,cinder:UPDATE=115,cinder:DELETE=8 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:13:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:41 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.info Sep 17 17:13:41 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:41 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89" returned: 0 in 0.456s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44fe356f-bee5-48a2-8f86-eebd2e159617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[078cfa63-6240-4ed3-ac83-0ef316bc2651]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:41 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.info" returned: 0 in 0.360s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:41 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.info is being set with open permissions: ugo+rw Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:41 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.info Sep 17 17:13:41 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:41 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 Sep 17 17:13:41 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:41 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.info" returned: 0 in 0.267s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.202s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1837784732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b328961d-1f96-45ee-a0aa-ba6e7c3bf76b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:28Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Creating volume b328961d-1f96-45ee-a0aa-ba6e7c3bf76b {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:13:41 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:41 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b 1073741824 Sep 17 17:13:41 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-2eebe5b5-07e4-45e1-99e3-106164e56616 req-017a348b-2f60-4293-b21c-1b2de9ade88d tempest-VolumesSnapshotsTestJSON-1538710784 None] Create snapshot completed successfully Sep 17 17:13:41 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617" returned: 0 in 0.423s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:41 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 Sep 17 17:13:41 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:42 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89" returned: 0 in 0.411s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:42 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b 1073741824" returned: 0 in 0.510s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:42 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89 Sep 17 17:13:42 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:42 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b Sep 17 17:13:42 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Acquiring lock "cinder-9caf4051-fc0a-407a-929e-b3a4c32bea55-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "cinder-9caf4051-fc0a-407a-929e-b3a4c32bea55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Acquiring lock "cinder-quobyte-e3fd5906-9d61-46ba-84a6-97df9c3a8858" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:42 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "cinder-quobyte-e3fd5906-9d61-46ba-84a6-97df9c3a8858" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Acquiring lock "cinder-quobyte-9caf4051-fc0a-407a-929e-b3a4c32bea55" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617.14c11ece-6270-4f71-adbc-743377350d89" returned: 0 in 0.302s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "cinder-quobyte-9caf4051-fc0a-407a-929e-b3a4c32bea55" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Deleting offline snapshot 9caf4051-fc0a-407a-929e-b3a4c32bea55 of volume e3fd5906-9d61-46ba-84a6-97df9c3a8858 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] snapshot_file for this snap is: volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbcd1f8-a9cb-4cd9-bbd4-f4207a6ab868]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "cinder-quobyte-14c11ece-6270-4f71-adbc-743377350d89" released by "_delete_snapshot" :: held 1.826s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "cinder-quobyte-44fe356f-bee5-48a2-8f86-eebd2e159617" released by "delete_snapshot" :: held 1.858s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:42 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b" returned: 0 in 0.409s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.143s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1586418410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094522b4-0fa9-4f90-905b-f9e3a423e53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:29Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Creating volume 094522b4-0fa9-4f90-905b-f9e3a423e53d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:13:42 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:42 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d 1073741824 Sep 17 17:13:42 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a3d91c-8b0d-4b48-81b7-51c19baa19a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ea22e9-76f6-4623-b9df-7d84730b4dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:42 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 Sep 17 17:13:42 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:42 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b (b328961d-1f96-45ee-a0aa-ba6e7c3bf76b): created successfully Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ea22e9-76f6-4623-b9df-7d84730b4dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (932b96f1-1068-41c3-b92e-cd7a83e42fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Created reservations ['3db3843f-5e8c-48fa-8474-954c2a7d950f', 'f86795ea-b785-4ba7-89fa-6d26df63f7da', 'd981bfc5-60e1-4487-bcfa-37a316d4d442', 'fb5eb154-cd86-4078-91b3-26df7f299048'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:42 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-2e4a0099-d866-4303-b9a5-3b3c697270d3 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created volume successfully. Sep 17 17:13:42 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Delete snapshot completed successfully. Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9a5dba3f-af87-43a9-b1a1-f88a0674a26d tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "cinder-14c11ece-6270-4f71-adbc-743377350d89-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Acquiring lock "cinder-44fe356f-bee5-48a2-8f86-eebd2e159617-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:43 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55" returned: 0 in 0.463s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "cinder-44fe356f-bee5-48a2-8f86-eebd2e159617-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4baaf29-7a22-4277-94ac-ec11af8c1257]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Acquiring lock "cinder-quobyte-44fe356f-bee5-48a2-8f86-eebd2e159617" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "cinder-quobyte-44fe356f-bee5-48a2-8f86-eebd2e159617" acquired by "delete_volume" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:43 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 Sep 17 17:13:43 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c84be0-af64-4a0e-9a51-3c1b2885bcfd]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:43 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d 1073741824" returned: 0 in 0.643s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:43 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 Sep 17 17:13:43 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:43 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d Sep 17 17:13:43 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:43 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858" returned: 0 in 0.510s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:43 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 Sep 17 17:13:43 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:43 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d" returned: 0 in 0.334s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.552s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075678447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1e73b1-34d1-491a-915b-fcbd93d3ba94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:30Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Creating volume 4a1e73b1-34d1-491a-915b-fcbd93d3ba94 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:13:43 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:43 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617" returned: 0 in 0.523s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:43 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94 1073741824 Sep 17 17:13:43 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7eed97d-d57b-4b15-88e2-37f80c709769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094522b4-0fa9-4f90-905b-f9e3a423e53d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea35a535-507a-48f8-bb36-e9ed7038f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:43 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617 Sep 17 17:13:43 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:43 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume volume-094522b4-0fa9-4f90-905b-f9e3a423e53d (094522b4-0fa9-4f90-905b-f9e3a423e53d): created successfully Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea35a535-507a-48f8-bb36-e9ed7038f872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (29a0edee-3232-418b-99af-8b6b2ebd33c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:43 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6ea4b84d-9755-42b0-b8df-96b2c8351cd1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created volume successfully. Sep 17 17:13:43 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55" returned: 0 in 0.414s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:44 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-44fe356f-bee5-48a2-8f86-eebd2e159617" returned: 0 in 0.280s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:44 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55 Sep 17 17:13:44 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "cinder-quobyte-44fe356f-bee5-48a2-8f86-eebd2e159617" released by "delete_volume" :: held 0.873s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Created reservations ['868d18da-cf36-4607-813f-6cffaa718089', '28e193b1-880c-45e7-8592-e91f42ad0209', '70635fb5-3278-4c05-8cf1-2e2d3640f14f', '2d56e631-ca7e-4961-833e-270d95a40386'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:44 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:44 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:44 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94 1073741824" returned: 0 in 0.580s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:44 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858.9caf4051-fc0a-407a-929e-b3a4c32bea55" returned: 0 in 0.315s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "cinder-quobyte-9caf4051-fc0a-407a-929e-b3a4c32bea55" released by "_delete_snapshot" :: held 1.880s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "cinder-quobyte-e3fd5906-9d61-46ba-84a6-97df9c3a8858" released by "delete_snapshot" :: held 1.940s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:44 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94 Sep 17 17:13:44 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.quota [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Created reservations ['f4ec8fe5-744a-4a2c-8987-0f667fb94274', '82b3c576-67c9-4f31-97ab-6d033aefff90', 'dacd0ee0-b27a-4848-9e01-a08e225045b3', 'c65b6fde-f1a0-483c-91bb-2f15399c0ace'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:44 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.295s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Deleted volume successfully. Sep 17 17:13:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Delete snapshot completed successfully. Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7adcee2e-aec2-463d-88ed-8c4941e90b9a tempest-VolumesSnapshotNegativeTestJSON-1322508369 None] Lock "cinder-44fe356f-bee5-48a2-8f86-eebd2e159617-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1b2b45f9-717c-4eea-9820-8a7d477389fd req-4cf87233-7954-44d2-b4ad-aed18968614e tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "cinder-9caf4051-fc0a-407a-929e-b3a4c32bea55-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:44 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94" returned: 0 in 0.350s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.996s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2077758725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c249b0e7-7ff6-43c4-8720-eff2a20b83a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:30Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Creating volume c249b0e7-7ff6-43c4-8720-eff2a20b83a5 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:13:44 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Acquiring lock "cinder-e3fd5906-9d61-46ba-84a6-97df9c3a8858-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3a72a4-f2bf-4a15-a486-3f7509e2dc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:44 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5 1073741824 Sep 17 17:13:44 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f02c7e-cbfc-4cf7-82ab-8e4f785a39eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "cinder-e3fd5906-9d61-46ba-84a6-97df9c3a8858-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:44 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94 (4a1e73b1-34d1-491a-915b-fcbd93d3ba94): created successfully Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f02c7e-cbfc-4cf7-82ab-8e4f785a39eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (06df7da9-d309-4d5d-a3d1-5e12ff2d162e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-11eac0ba-eafe-4427-bd9d-3ca7e93b574f tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created volume successfully. Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Acquiring lock "cinder-quobyte-e3fd5906-9d61-46ba-84a6-97df9c3a8858" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "cinder-quobyte-e3fd5906-9d61-46ba-84a6-97df9c3a8858" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[579dc4e7-92f8-47ac-a29f-1626d5d9455c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:45 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 Sep 17 17:13:45 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:45 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5 1073741824" returned: 0 in 0.572s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:45 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5 Sep 17 17:13:45 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:45 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858" returned: 0 in 0.441s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:45 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858 Sep 17 17:13:45 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:45 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5" returned: 0 in 0.418s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:45 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.518s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-599782204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6596bf3a-854f-42b8-af48-8ae82150d902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b11b670a5646b7b1d8c9d2c1b8a612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:31Z,use_quota=True,user_id='d20f3ea8005d4530abb36a466bba4eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Creating volume 6596bf3a-854f-42b8-af48-8ae82150d902 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:13:45 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e3fd5906-9d61-46ba-84a6-97df9c3a8858" returned: 0 in 0.367s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:45 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902 1073741824 Sep 17 17:13:45 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "cinder-quobyte-e3fd5906-9d61-46ba-84a6-97df9c3a8858" released by "delete_volume" :: held 0.926s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6faa4f-dbfc-4ef6-b28a-b4686deb56e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d13c46-72ff-451f-ad8e-da99a0c656b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:45 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5 (c249b0e7-7ff6-43c4-8720-eff2a20b83a5): created successfully Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d13c46-72ff-451f-ad8e-da99a0c656b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (b9991b49-5afc-466c-83fe-064b95761b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-eb943198-f023-4f0f-8b44-f2e79004c108 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created volume successfully. Sep 17 17:13:45 devstack cinder-volume[85889]: DEBUG cinder.quota [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Created reservations ['ce5c026f-d7bf-42cb-b7e2-3623dd8943f5', 'b7aa3368-520d-4277-beab-91c141b9b05e', '84d20ee4-31e4-4ba3-b504-a3547b93caaf', '7646bdac-bed1-425b-b03d-d2c1d967d2d5'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:46 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:46 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:46 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.342s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG cinder.manager [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:46 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Deleted volume successfully. Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902 1073741824" returned: 0 in 0.641s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-1cf69e11-f15b-4e35-9b02-5f0f0e669b6a req-a507c64b-65b5-4ef9-aa2c-e51d4eaeac1a tempest-VolumesSnapshotsTestJSON-1538710784 None] Lock "cinder-e3fd5906-9d61-46ba-84a6-97df9c3a8858-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:46 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902 Sep 17 17:13:46 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:46 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902" returned: 0 in 0.299s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d956212-4d48-4524-8ef4-dfffaa03a487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6596bf3a-854f-42b8-af48-8ae82150d902', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faeb9460-4673-4838-819a-f35b21ff0dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:46 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Volume volume-6596bf3a-854f-42b8-af48-8ae82150d902 (6596bf3a-854f-42b8-af48-8ae82150d902): created successfully Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faeb9460-4673-4838-819a-f35b21ff0dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Flow 'volume_create_manager' (001f7220-f94f-40a8-b460-ea49f33b380e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e71e6bc2-45aa-424b-8ff9-da6e849169d4 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created volume successfully. Sep 17 17:13:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-6596bf3a-854f-42b8-af48-8ae82150d902-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-6596bf3a-854f-42b8-af48-8ae82150d902-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-quobyte-6596bf3a-854f-42b8-af48-8ae82150d902" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-6596bf3a-854f-42b8-af48-8ae82150d902" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:47 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e265553-7833-477f-8968-0784c74b0234]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:47 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902 Sep 17 17:13:47 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:47 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902" returned: 0 in 0.411s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:48 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902 Sep 17 17:13:48 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:48 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6596bf3a-854f-42b8-af48-8ae82150d902" returned: 0 in 0.271s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-6596bf3a-854f-42b8-af48-8ae82150d902" released by "delete_volume" :: held 0.735s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created reservations ['88909ea7-a761-46b1-af97-af21f42fa2a3', '340036a4-642a-42be-95d7-1f8f27994f02', '9787d61f-ecb6-48c9-a2c5-725b18cb901b', 'c9a68857-0756-4837-8a98-24c3b2589c56'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:48 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:48 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-c249b0e7-7ff6-43c4-8720-eff2a20b83a5-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-c249b0e7-7ff6-43c4-8720-eff2a20b83a5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-quobyte-c249b0e7-7ff6-43c4-8720-eff2a20b83a5" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-c249b0e7-7ff6-43c4-8720-eff2a20b83a5" acquired by "delete_volume" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fb59b0-9a19-4546-adb7-234475164ab8]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:48 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.488s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:48 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Deleted volume successfully. Sep 17 17:13:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5df85fc2-6331-4e25-9351-c9264cab69aa tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-6596bf3a-854f-42b8-af48-8ae82150d902-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:49 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5 Sep 17 17:13:49 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:49 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5" returned: 0 in 0.535s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:49 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5 Sep 17 17:13:49 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:49 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c249b0e7-7ff6-43c4-8720-eff2a20b83a5" returned: 0 in 0.371s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-c249b0e7-7ff6-43c4-8720-eff2a20b83a5" released by "delete_volume" :: held 0.983s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:49 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created reservations ['39bc0159-8d28-49b6-a483-1cf46767256a', '2a79b2d0-632c-45f6-9e44-b9b2625c4db6', 'f27c9801-99bb-4fc5-a074-5a7efd19b0fd', '4ae97150-2edd-4547-963c-d3aa9444cdaa'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:50 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:50 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:50 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.347s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:50 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Deleted volume successfully. Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12c38dbf-f03c-4158-9425-512d85fe510b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-c249b0e7-7ff6-43c4-8720-eff2a20b83a5-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Flow 'volume_create_manager' (22a37fce-907d-4cf5-a5d2-acad6bf57d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95555e25-5708-4ca0-8a95-327418c8c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95555e25-5708-4ca0-8a95-327418c8c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1526224784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5277e2-fc71-49ae-83e2-0e48656a6d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d229d66fb3dc443ab85ed42bc6a13df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:50Z,use_quota=True,user_id='410c292c320d42e09794d1981a0adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76aaa8bc-123c-4b3e-923d-3e529ec23c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76aaa8bc-123c-4b3e-923d-3e529ec23c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6f06bc-2fb2-4bfa-9042-cc6f0db7d9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6f06bc-2fb2-4bfa-9042-cc6f0db7d9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5277e2-fc71-49ae-83e2-0e48656a6d39', 'volume_name': 'volume-be5277e2-fc71-49ae-83e2-0e48656a6d39', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab0e932-3bc8-461f-8a94-0e2305bcfaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab0e932-3bc8-461f-8a94-0e2305bcfaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf996b41-ed31-4297-a14e-fde6b9fab63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:50 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Volume be5277e2-fc71-49ae-83e2-0e48656a6d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5277e2-fc71-49ae-83e2-0e48656a6d39', 'volume_size': 1} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1526224784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5277e2-fc71-49ae-83e2-0e48656a6d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d229d66fb3dc443ab85ed42bc6a13df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:50Z,use_quota=True,user_id='410c292c320d42e09794d1981a0adbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Creating volume be5277e2-fc71-49ae-83e2-0e48656a6d39 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:13:50 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:13:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:50 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39 1073741824 Sep 17 17:13:50 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-4a1e73b1-34d1-491a-915b-fcbd93d3ba94-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-4a1e73b1-34d1-491a-915b-fcbd93d3ba94-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:51 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39 1073741824" returned: 0 in 0.587s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-quobyte-4a1e73b1-34d1-491a-915b-fcbd93d3ba94" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-4a1e73b1-34d1-491a-915b-fcbd93d3ba94" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[36095886-61a3-4c3c-a60e-6024210e75f9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:51 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39 Sep 17 17:13:51 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:51 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94 Sep 17 17:13:51 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:51 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39" returned: 0 in 0.329s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf996b41-ed31-4297-a14e-fde6b9fab63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5277e2-fc71-49ae-83e2-0e48656a6d39', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f3cebc-9fa0-44ca-99f1-8f092cd36cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:51 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Volume volume-be5277e2-fc71-49ae-83e2-0e48656a6d39 (be5277e2-fc71-49ae-83e2-0e48656a6d39): created successfully Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f3cebc-9fa0-44ca-99f1-8f092cd36cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Flow 'volume_create_manager' (22a37fce-907d-4cf5-a5d2-acad6bf57d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a7ac8f0a-6f21-4a18-927f-106865b8cafb tempest-VolumesNegativeTest-322122324 None] Created volume successfully. Sep 17 17:13:51 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94" returned: 0 in 0.475s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:51 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94 Sep 17 17:13:51 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:52 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4a1e73b1-34d1-491a-915b-fcbd93d3ba94" returned: 0 in 0.272s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-4a1e73b1-34d1-491a-915b-fcbd93d3ba94" released by "delete_volume" :: held 0.817s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created reservations ['ae558045-893a-4fe1-91a9-110cb58f5a6d', '0ad385bc-e505-4fb4-a13c-50f6214c7e1f', 'cd94d788-8f3d-44db-9618-0e8ae39c746b', '75832465-5474-4299-a6d3-7250ad8026bc'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:52 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:52 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-094522b4-0fa9-4f90-905b-f9e3a423e53d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-094522b4-0fa9-4f90-905b-f9e3a423e53d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-quobyte-094522b4-0fa9-4f90-905b-f9e3a423e53d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-094522b4-0fa9-4f90-905b-f9e3a423e53d" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e20e39-29fc-4aac-8ea9-0895ae566988]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:52 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.409s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:52 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Deleted volume successfully. Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-51a87784-0476-4923-ae1f-1add59e5289b tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-4a1e73b1-34d1-491a-915b-fcbd93d3ba94-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Flow 'volume_create_manager' (45b9b5be-8646-42e8-b340-ad9959b4d625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:52 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d Sep 17 17:13:52 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a29f20-c292-4766-8396-6e5a7f1107bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a29f20-c292-4766-8396-6e5a7f1107bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1237217358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a37cb30-eff4-416b-823b-f73bd7f532ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5b3cb522d2ca40d09f12c3145a112640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:53Z,use_quota=True,user_id='b9949f3bd9204253bd06e1e79e1515e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc150463-6aa8-41be-920d-c84fad12b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc150463-6aa8-41be-920d-c84fad12b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1727ace7-7145-430e-94a2-25c44cc3cb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1727ace7-7145-430e-94a2-25c44cc3cb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a37cb30-eff4-416b-823b-f73bd7f532ac', 'volume_name': 'volume-2a37cb30-eff4-416b-823b-f73bd7f532ac', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06c270a-9d2f-45ee-a533-ba73776796ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06c270a-9d2f-45ee-a533-ba73776796ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a852af49-0067-458a-aead-ef7eff30665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:52 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Volume 2a37cb30-eff4-416b-823b-f73bd7f532ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a37cb30-eff4-416b-823b-f73bd7f532ac', 'volume_size': 1} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1237217358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a37cb30-eff4-416b-823b-f73bd7f532ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5b3cb522d2ca40d09f12c3145a112640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:13:53Z,use_quota=True,user_id='b9949f3bd9204253bd06e1e79e1515e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Creating volume 2a37cb30-eff4-416b-823b-f73bd7f532ac {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:13:52 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:13:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:52 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac 1073741824 Sep 17 17:13:52 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:53 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d" returned: 0 in 0.518s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:53 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d Sep 17 17:13:53 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:53 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-094522b4-0fa9-4f90-905b-f9e3a423e53d" returned: 0 in 0.346s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:53 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac 1073741824" returned: 0 in 0.597s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-094522b4-0fa9-4f90-905b-f9e3a423e53d" released by "delete_volume" :: held 0.974s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created reservations ['6247eae2-14dd-4968-a451-688448dfef27', 'dbb9f3be-e35b-4116-a3f0-ef43a7f560ed', '1e86a808-228e-44df-aa9f-3f6cfadbd46f', '9974ac2a-2e9b-4ef8-b81a-2d435ee66bb8'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:53 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac Sep 17 17:13:53 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:53 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:53 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:53 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac" returned: 0 in 0.456s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:53 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a852af49-0067-458a-aead-ef7eff30665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a37cb30-eff4-416b-823b-f73bd7f532ac', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d47b13-b2dc-4d0b-94f3-6caece5535dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.355s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Deleted volume successfully. Sep 17 17:13:54 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Volume volume-2a37cb30-eff4-416b-823b-f73bd7f532ac (2a37cb30-eff4-416b-823b-f73bd7f532ac): created successfully Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d47b13-b2dc-4d0b-94f3-6caece5535dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Flow 'volume_create_manager' (45b9b5be-8646-42e8-b340-ad9959b4d625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:13:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-06b9d9b7-a39d-4738-bc5f-db98f99a24d9 req-eb89cef4-78af-4127-99b6-e6aa8452ae41 tempest-VolumesGetTestJSON-1933778225 None] Created volume successfully. Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bc71ce76-7ab1-4084-961d-69e29352ef43 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-094522b4-0fa9-4f90-905b-f9e3a423e53d-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-quobyte-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabea0a4-8e08-42c0-889b-a1f09447f51a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:55 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b Sep 17 17:13:55 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Acquiring lock "cinder-2a37cb30-eff4-416b-823b-f73bd7f532ac-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Lock "cinder-2a37cb30-eff4-416b-823b-f73bd7f532ac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Acquiring lock "cinder-quobyte-2a37cb30-eff4-416b-823b-f73bd7f532ac" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Lock "cinder-quobyte-2a37cb30-eff4-416b-823b-f73bd7f532ac" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:55 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cfce9c-7f18-4e79-ab4d-9bdb4da03de7]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:55 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b" returned: 0 in 0.673s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:55 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b Sep 17 17:13:55 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:55 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac Sep 17 17:13:55 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:56 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:56 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b" returned: 0 in 0.526s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac" returned: 0 in 0.670s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b" released by "delete_volume" :: held 1.288s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:56 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac Sep 17 17:13:56 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created reservations ['7acc1007-bb22-484a-998a-211345ecf280', '3b7144bf-52a0-4c71-bfff-01ee96ab1e0a', '1ff081dd-9403-4ac1-a92a-d59b03e7716d', 'ca76d983-f7f7-4ff5-a97d-6a96c86937f3'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:56 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:56 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:56 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a37cb30-eff4-416b-823b-f73bd7f532ac" returned: 0 in 0.377s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Lock "cinder-quobyte-2a37cb30-eff4-416b-823b-f73bd7f532ac" released by "delete_volume" :: held 1.135s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.quota [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Created reservations ['834c3f59-ffca-4810-a2dc-0edde522290e', 'b4c80c58-0ad2-48f0-98ea-914a7db17b41', '07541eee-7d26-4b7b-b5b2-e1a23807013d', '32954e0f-1504-4241-a048-20675e8c9d41'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:56 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.341s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Deleted volume successfully. Sep 17 17:13:56 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:13:56 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62b2c465-5e34-4f6d-aabc-05058c401229 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-b328961d-1f96-45ee-a0aa-ba6e7c3bf76b-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:56 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.285s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:56 devstack cinder-volume[85889]: DEBUG cinder.manager [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:13:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Deleted volume successfully. Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-6b2aa358-edac-4bb4-9474-373b514c10f4 req-2bf8937a-bae9-4ad1-8a03-10cdeafba608 tempest-VolumesGetTestJSON-1933778225 None] Lock "cinder-2a37cb30-eff4-416b-823b-f73bd7f532ac-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-cce16d3e-180a-4a4d-b9a7-b9974a24bc16-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-cce16d3e-180a-4a4d-b9a7-b9974a24bc16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-quobyte-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-quobyte-cce16d3e-180a-4a4d-b9a7-b9974a24bc16" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-cce16d3e-180a-4a4d-b9a7-b9974a24bc16" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Deleting offline snapshot cce16d3e-180a-4a4d-b9a7-b9974a24bc16 of volume e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] snapshot_file for this snap is: volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80e78d4-d875-4b6f-b372-7aee11c81d8c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:57 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 Sep 17 17:13:57 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:57 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16" returned: 0 in 0.462s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf516b62-3d98-4f72-ae19-058c9e9e5be2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:58 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 Sep 17 17:13:58 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:58 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" returned: 0 in 0.562s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:58 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 Sep 17 17:13:58 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:58 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16" returned: 0 in 0.423s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:58 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16 Sep 17 17:13:58 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:59 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4.cce16d3e-180a-4a4d-b9a7-b9974a24bc16" returned: 0 in 0.269s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-cce16d3e-180a-4a4d-b9a7-b9974a24bc16" released by "_delete_snapshot" :: held 1.879s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" released by "delete_snapshot" :: held 1.961s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created reservations ['fdc55853-e059-459e-a273-39ffee6b071c', '0428ab2a-b618-4258-b829-37f9af132ef8', '5c1fcd82-7a6b-4d3d-8a94-567f3a457aa3', 'cd4f4de8-6236-4fcb-b1a7-c66a3457a92d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:13:59 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Delete snapshot completed successfully. Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-65eaae8e-2ed8-4f8e-860b-3efd757f3be1 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-cce16d3e-180a-4a4d-b9a7-b9974a24bc16-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "cinder-quobyte-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" acquired by "delete_volume" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d5f56c-61b9-455e-83ef-dfee25d8bb13]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:13:59 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 Sep 17 17:13:59 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:13:59 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" returned: 0 in 0.412s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:13:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:00 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4 Sep 17 17:14:00 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:00 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" returned: 0 in 0.396s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-quobyte-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4" released by "delete_volume" :: held 0.924s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:00 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Created reservations ['e47d9ffe-2688-4c99-96b4-68c1befaceea', 'd2c5cba3-7a6c-4af6-9437-4ef4f117b717', '5f9de2bc-f7c3-4bcf-a4d5-b238e783c117', '9f4cad56-a13a-4cfc-b67f-13a5d27d58f1'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:00 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:14:00 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:01 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.466s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:01 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:14:01 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Deleted volume successfully. Sep 17 17:14:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-98df7d1a-1e99-4168-b237-f952e27b6839 tempest-CreateVolumesFromSnapshotTest-1899045236 None] Lock "cinder-e0fa6c6f-b5b6-45d9-809b-4b7d8d08c7a4-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Flow 'volume_create_manager' (b101b90c-5845-4cb2-ab1c-e076a2418678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c769a4ca-4af7-4412-9c5e-6f396605f9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c769a4ca-4af7-4412-9c5e-6f396605f9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-925862578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11b709b-744d-4679-990f-3b9d552b6be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25bcb66969043a7a77f67c6ecd9e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:08Z,use_quota=True,user_id='e7b9bd876ffe461dbc8b191b02f5ee7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfca533f-80cd-41f4-a7c9-cc677706a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfca533f-80cd-41f4-a7c9-cc677706a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e71eba-1627-45a0-beea-5b2e8958d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e71eba-1627-45a0-beea-5b2e8958d146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11b709b-744d-4679-990f-3b9d552b6be3', 'volume_name': 'volume-e11b709b-744d-4679-990f-3b9d552b6be3', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5d2bc7-8903-4fac-9bdd-ef12f01bf6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5d2bc7-8903-4fac-9bdd-ef12f01bf6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324835c7-a14a-48ac-a64b-85bb2c21d355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:08 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Volume e11b709b-744d-4679-990f-3b9d552b6be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11b709b-744d-4679-990f-3b9d552b6be3', 'volume_size': 1} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-925862578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11b709b-744d-4679-990f-3b9d552b6be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25bcb66969043a7a77f67c6ecd9e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:08Z,use_quota=True,user_id='e7b9bd876ffe461dbc8b191b02f5ee7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Creating volume e11b709b-744d-4679-990f-3b9d552b6be3 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:14:08 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:14:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:08 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 1073741824 Sep 17 17:14:08 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:09 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 1073741824" returned: 0 in 0.813s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:09 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 Sep 17 17:14:09 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ce789b95-39dd-4842-9daa-3b1804aa4221 tempest-GroupsTest-475059644 None] Group tempest-Group1-547785447: creating Sep 17 17:14:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ce789b95-39dd-4842-9daa-3b1804aa4221 tempest-GroupsTest-475059644 None] Group tempest-Group1-547785447: created successfully Sep 17 17:14:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ce789b95-39dd-4842-9daa-3b1804aa4221 tempest-GroupsTest-475059644 None] Create group completed successfully. Sep 17 17:14:09 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3" returned: 0 in 0.403s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:14:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324835c7-a14a-48ac-a64b-85bb2c21d355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11b709b-744d-4679-990f-3b9d552b6be3', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35ab6a6-68bb-4b50-bcd5-a2f70986dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:09 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Volume volume-e11b709b-744d-4679-990f-3b9d552b6be3 (e11b709b-744d-4679-990f-3b9d552b6be3): created successfully Sep 17 17:14:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35ab6a6-68bb-4b50-bcd5-a2f70986dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Flow 'volume_create_manager' (b101b90c-5845-4cb2-ab1c-e076a2418678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bb7d2d85-674c-4eca-aa4a-6b03cad9eb74 tempest-VolumeDependencyTests-659852635 None] Created volume successfully. Sep 17 17:14:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Creating offline snapshot e8bc663e-6976-4918-8603-97090910519c of volume e11b709b-744d-4679-990f-3b9d552b6be3 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:14:10 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1185a9-4cdd-4f2e-8c43-eb8c0fe5b5dd]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:10 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 Sep 17 17:14:10 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a4512592-c1ea-4915-9e0d-3e08a8494283 tempest-GroupsTest-475059644 None] Group tempest-Group2-1067040148: creating Sep 17 17:14:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a4512592-c1ea-4915-9e0d-3e08a8494283 tempest-GroupsTest-475059644 None] Group tempest-Group2-1067040148: created successfully Sep 17 17:14:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a4512592-c1ea-4915-9e0d-3e08a8494283 tempest-GroupsTest-475059644 None] Create group completed successfully. Sep 17 17:14:10 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3" returned: 0 in 0.561s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:10 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c 1G Sep 17 17:14:10 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:11 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c 1G" returned: 0 in 0.599s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11b709b-744d-4679-990f-3b9d552b6be3 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:11 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11b709b-744d-4679-990f-3b9d552b6be3 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c Sep 17 17:14:11 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:11 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11b709b-744d-4679-990f-3b9d552b6be3 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c" returned: 0 in 0.449s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:11 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c is being set with open permissions: ugo+rw Sep 17 17:14:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:11 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c Sep 17 17:14:11 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:12 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c" returned: 0 in 0.430s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:12 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.info Sep 17 17:14:12 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Flow 'volume_create_manager' (75afd43a-17a5-4713-897a-9d198694d742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa06099-5b95-431f-92a9-4ebdcfaff34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa06099-5b95-431f-92a9-4ebdcfaff34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1161621582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9de0ef59-fe3f-4921-9dde-c42941cd861d,host='devstack@QuobyteHD#QuobyteHD',id=9b7bc254-917d-4924-a12d-500fc2839c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c54b2d7ec9f492e977706780be5fa5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:12Z,use_quota=True,user_id='bc41e17122cb4fa3bdb548705a72da3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7811bf8c-48b9-4335-92c8-ed5910c1a4eb),volume_type_id=7811bf8c-48b9-4335-92c8-ed5910c1a4eb)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bcc9d8-cea0-4f6b-a341-868e63a8eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bcc9d8-cea0-4f6b-a341-868e63a8eae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa72d08-e703-480d-993a-524789108bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa72d08-e703-480d-993a-524789108bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7bc254-917d-4924-a12d-500fc2839c17', 'volume_name': 'volume-9b7bc254-917d-4924-a12d-500fc2839c17', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00eb2f06-27cd-4d34-a98f-a4319a57bd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00eb2f06-27cd-4d34-a98f-a4319a57bd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12b6b41-a1a0-43eb-b6c7-096629f470f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:12 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Volume 9b7bc254-917d-4924-a12d-500fc2839c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7bc254-917d-4924-a12d-500fc2839c17', 'volume_size': 1} Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:12 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.info" returned: 0 in 0.434s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:12 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.info is being set with open permissions: ugo+rw Sep 17 17:14:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:12 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.info Sep 17 17:14:12 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:13 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.info" returned: 0 in 0.349s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.953s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.415s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9de0ef59-fe3f-4921-9dde-c42941cd861d,created_at=2026-09-17T15:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1161621582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9de0ef59-fe3f-4921-9dde-c42941cd861d,host='devstack@QuobyteHD#QuobyteHD',id=9b7bc254-917d-4924-a12d-500fc2839c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c54b2d7ec9f492e977706780be5fa5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:12Z,use_quota=True,user_id='bc41e17122cb4fa3bdb548705a72da3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7811bf8c-48b9-4335-92c8-ed5910c1a4eb),volume_type_id=7811bf8c-48b9-4335-92c8-ed5910c1a4eb)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Creating volume 9b7bc254-917d-4924-a12d-500fc2839c17 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:14:13 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:13 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17 1073741824 Sep 17 17:14:13 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-93ae6097-0e0e-4f81-b516-78a190367fd6 tempest-VolumeDependencyTests-659852635 None] Create snapshot completed successfully Sep 17 17:14:13 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17 1073741824" returned: 0 in 0.679s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:13 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17 Sep 17 17:14:13 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Flow 'volume_create_manager' (b546c53d-649f-4b4b-a603-1b0a2e57ee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50235e8-af24-4362-a543-85a4240ca532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50235e8-af24-4362-a543-85a4240ca532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-510585204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570039dc-1b94-46a9-98ea-c8f6544a6f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25bcb66969043a7a77f67c6ecd9e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e8bc663e-6976-4918-8603-97090910519c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:14Z,use_quota=True,user_id='e7b9bd876ffe461dbc8b191b02f5ee7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdb83ad-7790-4d67-aa73-403c22b19d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdb83ad-7790-4d67-aa73-403c22b19d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0050dc-9237-4bcf-bbe6-14e603b574b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0050dc-9237-4bcf-bbe6-14e603b574b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '570039dc-1b94-46a9-98ea-c8f6544a6f9d', 'volume_name': 'volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d', 'volume_size': 1, 'snapshot_id': 'e8bc663e-6976-4918-8603-97090910519c'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f2c965-2907-47df-8ce5-454e65f30d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f2c965-2907-47df-8ce5-454e65f30d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59418173-1bae-4d6c-89aa-dab990329162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:14 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Volume 570039dc-1b94-46a9-98ea-c8f6544a6f9d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d', 'volume_size': 1, 'snapshot_id': 'e8bc663e-6976-4918-8603-97090910519c'} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:14 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17" returned: 0 in 0.386s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.040s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "cinder-quobyte-e8bc663e-6976-4918-8603-97090910519c-570039dc-1b94-46a9-98ea-c8f6544a6f9d" by "_create_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12b6b41-a1a0-43eb-b6c7-096629f470f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7bc254-917d-4924-a12d-500fc2839c17', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8ea331-c8de-4424-9c0f-1c57b1226d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-e8bc663e-6976-4918-8603-97090910519c-570039dc-1b94-46a9-98ea-c8f6544a6f9d" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Creating volume 570039dc-1b94-46a9-98ea-c8f6544a6f9d from snapshot e8bc663e-6976-4918-8603-97090910519c {{(pid=85889) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "cinder-quobyte-570039dc-1b94-46a9-98ea-c8f6544a6f9d" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:14 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Volume volume-9b7bc254-917d-4924-a12d-500fc2839c17 (9b7bc254-917d-4924-a12d-500fc2839c17): created successfully Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8ea331-c8de-4424-9c0f-1c57b1226d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Flow 'volume_create_manager' (75afd43a-17a5-4713-897a-9d198694d742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-570039dc-1b94-46a9-98ea-c8f6544a6f9d" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] snapshot: e8bc663e-6976-4918-8603-97090910519c, volume: 570039dc-1b94-46a9-98ea-c8f6544a6f9d, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:14:14 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0cd7b16a-fcdb-4367-a2ab-832ef7fb7c10 tempest-GroupsTest-475059644 None] Created volume successfully. Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c05e6a-5cf8-48d9-81cb-ef1c46676720]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:14 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c Sep 17 17:14:14 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:14 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c" returned: 0 in 0.452s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11b709b-744d-4679-990f-3b9d552b6be3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b13d0f-0575-4811-b72a-5a823eabdd39]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:15 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 Sep 17 17:14:15 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:15 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3" returned: 0 in 0.614s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:14:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:14:15 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:14:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:15 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d Sep 17 17:14:15 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Acquiring lock "cinder-quobyte-9b7bc254-917d-4924-a12d-500fc2839c17" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Lock "cinder-quobyte-9b7bc254-917d-4924-a12d-500fc2839c17" acquired by "delete_volume" :: waited 0.042s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:16 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[03927c68-29ba-4a16-bbb6-ee7e37d19f8a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:16 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17 Sep 17 17:14:16 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:17 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17" returned: 0 in 0.951s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:17 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17 Sep 17 17:14:17 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:17 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9b7bc254-917d-4924-a12d-500fc2839c17" returned: 0 in 0.531s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Lock "cinder-quobyte-9b7bc254-917d-4924-a12d-500fc2839c17" released by "delete_volume" :: held 1.599s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:17 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Created reservations ['3ec02fa1-fdde-47f1-bb49-537bdfaab982'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:17 devstack cinder-volume[85889]: WARNING cinder.quota [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1218515026 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1218515026, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:14:17 devstack cinder-volume[85889]: WARNING cinder.quota [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1218515026 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1218515026, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:14:17 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Created reservations ['ac8f2b48-7c4a-4415-a3d1-af108293a11a', '579efdab-b626-4151-ba17-3d1a58b817b4', '99db9493-4643-4d2e-be53-3670137a5f92', '27baea9b-1d8b-4929-8643-c7b42ebba57b'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:18 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:14:18 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:18 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.548s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:18 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:14:18 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f5f69e47-ffac-43cf-afa1-e322dd478b47 tempest-GroupsTest-475059644 None] Delete group completed successfully. Sep 17 17:14:19 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-6dbcb40e-4c65-4a04-9715-e547ff00bbc3 tempest-GroupsTest-475059644 None] Created reservations ['a2afd409-3827-4fa0-998c-a24bf4b897ae'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6dbcb40e-4c65-4a04-9715-e547ff00bbc3 tempest-GroupsTest-475059644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6dbcb40e-4c65-4a04-9715-e547ff00bbc3 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6dbcb40e-4c65-4a04-9715-e547ff00bbc3 tempest-GroupsTest-475059644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6dbcb40e-4c65-4a04-9715-e547ff00bbc3 tempest-GroupsTest-475059644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6dbcb40e-4c65-4a04-9715-e547ff00bbc3 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6dbcb40e-4c65-4a04-9715-e547ff00bbc3 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:19 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:14:19 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:19 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6dbcb40e-4c65-4a04-9715-e547ff00bbc3 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.588s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:19 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-6dbcb40e-4c65-4a04-9715-e547ff00bbc3 tempest-GroupsTest-475059644 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:14:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6dbcb40e-4c65-4a04-9715-e547ff00bbc3 tempest-GroupsTest-475059644 None] Delete group completed successfully. Sep 17 17:14:21 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9df69483-61ed-4411-8529-a88832f75e1b tempest-GroupsTest-475059644 None] Group tempest-GroupsTest-Group-1521135667: creating Sep 17 17:14:21 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9df69483-61ed-4411-8529-a88832f75e1b tempest-GroupsTest-475059644 None] Group tempest-GroupsTest-Group-1521135667: created successfully Sep 17 17:14:21 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9df69483-61ed-4411-8529-a88832f75e1b tempest-GroupsTest-475059644 None] Create group completed successfully. Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:22 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:14:22 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Acquiring lock "cinder-be5277e2-fc71-49ae-83e2-0e48656a6d39-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:22 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Lock "cinder-be5277e2-fc71-49ae-83e2-0e48656a6d39-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.622s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:14:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Acquiring lock "cinder-quobyte-be5277e2-fc71-49ae-83e2-0e48656a6d39" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Lock "cinder-quobyte-be5277e2-fc71-49ae-83e2-0e48656a6d39" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a89031-dc35-4d21-8022-a919528524dd]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:23 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39 Sep 17 17:14:23 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Flow 'volume_create_manager' (f84117cd-deb7-49e4-a59c-0fe63f4a1e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd947b8-83e2-412a-b6fb-bbd08f9fc2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd947b8-83e2-412a-b6fb-bbd08f9fc2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1229385113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=895e4740-139e-4f3c-a3c9-b6caac30c337,host='devstack@QuobyteHD#QuobyteHD',id=968e9a3d-9ff5-4cab-9649-32616e840f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c54b2d7ec9f492e977706780be5fa5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:24Z,use_quota=True,user_id='bc41e17122cb4fa3bdb548705a72da3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac622a3e-dde8-4ae8-b2f2-8c2678f067ac),volume_type_id=ac622a3e-dde8-4ae8-b2f2-8c2678f067ac)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f961f52e-0498-465a-ad36-133862f70e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f961f52e-0498-465a-ad36-133862f70e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:23 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fedbf84-1823-4ae1-b9bc-1ed225f6c6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fedbf84-1823-4ae1-b9bc-1ed225f6c6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968e9a3d-9ff5-4cab-9649-32616e840f45', 'volume_name': 'volume-968e9a3d-9ff5-4cab-9649-32616e840f45', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b4855a-e3d1-4912-9d0a-72dda08d0c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b4855a-e3d1-4912-9d0a-72dda08d0c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812a2d1b-705e-4d70-b2a8-bfab67559675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:24 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Volume 968e9a3d-9ff5-4cab-9649-32616e840f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968e9a3d-9ff5-4cab-9649-32616e840f45', 'volume_size': 1} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:24 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39" returned: 0 in 1.038s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:24 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39 Sep 17 17:14:24 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Flow 'volume_create_manager' (138444b9-07d3-483c-bed3-4281f2874a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faab1765-2cb3-476c-88f7-3560d3354c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faab1765-2cb3-476c-88f7-3560d3354c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1979354083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48dc92a6-b532-49bc-823e-ad88c39a7477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9586d5a717bb4f5c9bffbd8c9a6aaeb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:24Z,use_quota=True,user_id='2d271cea77ff4c43ac6322d060ecc411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08b3f742-ebe0-4be9-8043-5fac01e5c169),volume_type_id=08b3f742-ebe0-4be9-8043-5fac01e5c169)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a5fa44-2bc8-4a31-975c-6e1391383d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a5fa44-2bc8-4a31-975c-6e1391383d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a11deb1-166c-4fc9-a701-660ec4f9147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a11deb1-166c-4fc9-a701-660ec4f9147a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48dc92a6-b532-49bc-823e-ad88c39a7477', 'volume_name': 'volume-48dc92a6-b532-49bc-823e-ad88c39a7477', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0598cf-0874-459d-a416-09082f8332c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0598cf-0874-459d-a416-09082f8332c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a88533-8eae-409c-a140-85a44c952d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:24 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Volume 48dc92a6-b532-49bc-823e-ad88c39a7477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48dc92a6-b532-49bc-823e-ad88c39a7477', 'volume_size': 1} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:24 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be5277e2-fc71-49ae-83e2-0e48656a6d39" returned: 0 in 0.540s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Lock "cinder-quobyte-be5277e2-fc71-49ae-83e2-0e48656a6d39" released by "delete_volume" :: held 1.689s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:24 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Created reservations ['2cf5a890-2033-433b-88e8-60aee35e9adc', 'e4d59309-db57-4be3-8045-eec48d2975d0', '79481902-b21b-4f92-befe-c486b76512c7', '4763fddd-321e-4aab-9470-b8844c953655'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:25 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:14:25 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:25 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:25 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d" returned: 0 in 9.982s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3, size 1024.00 MB, duration 9.98 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:14:25 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Converted 1024.00 MB image at 102.57 MB/s Sep 17 17:14:25 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d is being set with open permissions: ugo+rw Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.501s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:14:25 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d Sep 17 17:14:25 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Flow 'volume_create_manager' (ae471073-fc1e-49ae-983f-6f8250ff887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2db2fe5-347b-42f1-9f41-097f367369e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:25 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Deleted volume successfully. Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2db2fe5-347b-42f1-9f41-097f367369e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-199482668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d39c001-39d1-41c0-a416-0696ae1fa641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9586d5a717bb4f5c9bffbd8c9a6aaeb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:25Z,use_quota=True,user_id='2d271cea77ff4c43ac6322d060ecc411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(466ff99e-fa85-4db5-b580-cf6118932259),volume_type_id=466ff99e-fa85-4db5-b580-cf6118932259)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6096e5-c446-4cb1-a64e-5d4e439b6b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6096e5-c446-4cb1-a64e-5d4e439b6b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76b8bb1-a20a-4aed-b9b5-720a94c05bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76b8bb1-a20a-4aed-b9b5-720a94c05bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d39c001-39d1-41c0-a416-0696ae1fa641', 'volume_name': 'volume-5d39c001-39d1-41c0-a416-0696ae1fa641', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d57ff11-3f34-408f-afab-f6cf3853f4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d57ff11-3f34-408f-afab-f6cf3853f4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d66a83-2c67-491d-bac9-9f85867d7c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:25 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Volume 5d39c001-39d1-41c0-a416-0696ae1fa641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d39c001-39d1-41c0-a416-0696ae1fa641', 'volume_size': 1} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b99f4c5c-25d3-44d2-80d7-b7da837273db tempest-VolumesNegativeTest-322122324 None] Lock "cinder-be5277e2-fc71-49ae-83e2-0e48656a6d39-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:25 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d" returned: 0 in 0.333s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-570039dc-1b94-46a9-98ea-c8f6544a6f9d" released by "_copy_volume_from_snapshot" :: held 11.497s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-e8bc663e-6976-4918-8603-97090910519c-570039dc-1b94-46a9-98ea-c8f6544a6f9d" released by "_create_volume_from_snapshot" :: held 11.597s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.635s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=895e4740-139e-4f3c-a3c9-b6caac30c337,created_at=2026-09-17T15:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1229385113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=895e4740-139e-4f3c-a3c9-b6caac30c337,host='devstack@QuobyteHD#QuobyteHD',id=968e9a3d-9ff5-4cab-9649-32616e840f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c54b2d7ec9f492e977706780be5fa5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:24Z,use_quota=True,user_id='bc41e17122cb4fa3bdb548705a72da3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac622a3e-dde8-4ae8-b2f2-8c2678f067ac),volume_type_id=ac622a3e-dde8-4ae8-b2f2-8c2678f067ac)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Creating volume 968e9a3d-9ff5-4cab-9649-32616e840f45 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:14:25 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:14:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:26 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45 1073741824 Sep 17 17:14:26 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59418173-1bae-4d6c-89aa-dab990329162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d', 'volume_size': 1, 'snapshot_id': 'e8bc663e-6976-4918-8603-97090910519c'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdd55b8-4b4e-4fa7-b8d6-7e1792b7f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:26 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Volume volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d (570039dc-1b94-46a9-98ea-c8f6544a6f9d): created successfully Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdd55b8-4b4e-4fa7-b8d6-7e1792b7f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Flow 'volume_create_manager' (b546c53d-649f-4b4b-a603-1b0a2e57ee1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:26 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b66469d7-1738-48dc-9a4d-250bcac22d31 tempest-VolumeDependencyTests-659852635 None] Created volume successfully. Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Flow 'volume_create_manager' (dcfb9964-9113-4446-aa56-2b1409015dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531e9014-a18d-4b44-9111-8ce5360af75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531e9014-a18d-4b44-9111-8ce5360af75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1478550935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381149aa-58ad-4345-8c58-09d550dd54b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9586d5a717bb4f5c9bffbd8c9a6aaeb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:26Z,use_quota=True,user_id='2d271cea77ff4c43ac6322d060ecc411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4229d2db-a991-47d5-9233-8c21b5c58b2e),volume_type_id=4229d2db-a991-47d5-9233-8c21b5c58b2e)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487203f3-8d35-4b2f-9976-e89795841c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487203f3-8d35-4b2f-9976-e89795841c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6bfc93-e379-4aac-8f13-9f0d15647a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.image.glance [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Creating Keystone auth plugin from conf {{(pid=85889) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 17:14:26 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45 1073741824" returned: 0 in 0.634s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Acquiring lock "cinder-e8bc663e-6976-4918-8603-97090910519c-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:26 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45 Sep 17 17:14:26 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Lock "cinder-e8bc663e-6976-4918-8603-97090910519c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Acquiring lock "cinder-quobyte-e11b709b-744d-4679-990f-3b9d552b6be3" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-e11b709b-744d-4679-990f-3b9d552b6be3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Acquiring lock "cinder-quobyte-e8bc663e-6976-4918-8603-97090910519c" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-e8bc663e-6976-4918-8603-97090910519c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Deleting offline snapshot e8bc663e-6976-4918-8603-97090910519c of volume e11b709b-744d-4679-990f-3b9d552b6be3 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] snapshot_file for this snap is: volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c056bba1-371d-4a4a-93a9-b1e50ab24378]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:26 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c Sep 17 17:14:26 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:26 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45" returned: 0 in 0.300s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.243s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1979354083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48dc92a6-b532-49bc-823e-ad88c39a7477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9586d5a717bb4f5c9bffbd8c9a6aaeb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:24Z,use_quota=True,user_id='2d271cea77ff4c43ac6322d060ecc411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08b3f742-ebe0-4be9-8043-5fac01e5c169),volume_type_id=08b3f742-ebe0-4be9-8043-5fac01e5c169)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Creating volume 48dc92a6-b532-49bc-823e-ad88c39a7477 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:14:26 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:14:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:27 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477 1073741824 Sep 17 17:14:27 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812a2d1b-705e-4d70-b2a8-bfab67559675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968e9a3d-9ff5-4cab-9649-32616e840f45', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23567854-c00a-483c-afc1-8d554d9cca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:27 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Volume volume-968e9a3d-9ff5-4cab-9649-32616e840f45 (968e9a3d-9ff5-4cab-9649-32616e840f45): created successfully Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23567854-c00a-483c-afc1-8d554d9cca1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Flow 'volume_create_manager' (f84117cd-deb7-49e4-a59c-0fe63f4a1e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6bfc93-e379-4aac-8f13-9f0d15647a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '381149aa-58ad-4345-8c58-09d550dd54b2', 'volume_name': 'volume-381149aa-58ad-4345-8c58-09d550dd54b2', 'volume_size': 1, 'image_id': '361e7547-55db-4a98-a576-1b70c305aa88', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361e7547-55db-4a98-a576-1b70c305aa88', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2121874887', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9586d5a717bb4f5c9bffbd8c9a6aaeb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361e7547-55db-4a98-a576-1b70c305aa88', 'created_at': datetime.datetime(2026, 9, 17, 15, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 14, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361e7547-55db-4a98-a576-1b70c305aa88/file', 'properties': {}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525bc42d-3fbb-4bba-a2de-02dcd55f5b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525bc42d-3fbb-4bba-a2de-02dcd55f5b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fec717-a420-4d29-894b-3d6ce943d419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:27 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Volume 381149aa-58ad-4345-8c58-09d550dd54b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-381149aa-58ad-4345-8c58-09d550dd54b2', 'volume_size': 1, 'image_id': '361e7547-55db-4a98-a576-1b70c305aa88', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361e7547-55db-4a98-a576-1b70c305aa88', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2121874887', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9586d5a717bb4f5c9bffbd8c9a6aaeb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361e7547-55db-4a98-a576-1b70c305aa88', 'created_at': datetime.datetime(2026, 9, 17, 15, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 14, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361e7547-55db-4a98-a576-1b70c305aa88/file', 'properties': {}}, 'image_service': } Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Trying to clone 381149aa-58ad-4345-8c58-09d550dd54b2 from image 361e7547-55db-4a98-a576-1b70c305aa88 at location (None, [{'url': 'file:///opt/stack/data/glance/images/361e7547-55db-4a98-a576-1b70c305aa88', 'metadata': {}}]). {{(pid=85889) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 17:14:27 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7f74caf5-a5bc-47dc-96a6-d53fe60c0a34 tempest-GroupsTest-475059644 None] Created volume successfully. Sep 17 17:14:27 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c" returned: 0 in 0.488s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11b709b-744d-4679-990f-3b9d552b6be3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[23911ef6-b725-4d0c-ad3f-d6273f8dbe6d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:27 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 Sep 17 17:14:27 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477 1073741824" returned: 0 in 0.571s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:27 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:27 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477 Sep 17 17:14:27 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:27 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477" returned: 0 in 0.385s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.202s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-199482668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d39c001-39d1-41c0-a416-0696ae1fa641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9586d5a717bb4f5c9bffbd8c9a6aaeb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:25Z,use_quota=True,user_id='2d271cea77ff4c43ac6322d060ecc411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(466ff99e-fa85-4db5-b580-cf6118932259),volume_type_id=466ff99e-fa85-4db5-b580-cf6118932259)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Creating volume 5d39c001-39d1-41c0-a416-0696ae1fa641 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:14:27 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:14:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:28 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a88533-8eae-409c-a140-85a44c952d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48dc92a6-b532-49bc-823e-ad88c39a7477', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:28 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641 1073741824 Sep 17 17:14:28 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04692ebf-0c95-466c-b9f3-a60f63c7372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3" returned: 0 in 0.714s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:28 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Volume volume-48dc92a6-b532-49bc-823e-ad88c39a7477 (48dc92a6-b532-49bc-823e-ad88c39a7477): created successfully Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04692ebf-0c95-466c-b9f3-a60f63c7372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Flow 'volume_create_manager' (138444b9-07d3-483c-bed3-4281f2874a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:28 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c Sep 17 17:14:28 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:28 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4d820410-668f-4356-9d68-dacfc0599fc1 tempest-TestInstancesWithCinderVolumes-318911255 None] Created volume successfully. Sep 17 17:14:28 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c" returned: 0 in 0.536s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:28 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c Sep 17 17:14:28 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Flow 'volume_create_manager' (3bbd16b2-8167-45e3-929d-9224dbdff5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:28 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa981bd-b89f-4fa5-915f-a8ad4e7e7971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641 1073741824" returned: 0 in 0.816s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa981bd-b89f-4fa5-915f-a8ad4e7e7971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-200041406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=895e4740-139e-4f3c-a3c9-b6caac30c337,host='devstack@QuobyteHD#QuobyteHD',id=e28b28a9-f21b-4589-a38e-6961dfaa1b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c54b2d7ec9f492e977706780be5fa5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:29Z,use_quota=True,user_id='bc41e17122cb4fa3bdb548705a72da3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac622a3e-dde8-4ae8-b2f2-8c2678f067ac),volume_type_id=ac622a3e-dde8-4ae8-b2f2-8c2678f067ac)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfb4e2f-5354-46d0-a4fa-d4f7596f19f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfb4e2f-5354-46d0-a4fa-d4f7596f19f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13df8d1-b3aa-4c4b-8e96-2bc214135061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13df8d1-b3aa-4c4b-8e96-2bc214135061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e28b28a9-f21b-4589-a38e-6961dfaa1b5a', 'volume_name': 'volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c06994-671a-434e-8360-3602fe50dc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c06994-671a-434e-8360-3602fe50dc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f13742-041b-438b-8ba8-616c150bf53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:28 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Volume e28b28a9-f21b-4589-a38e-6961dfaa1b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a', 'volume_size': 1} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:28 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641 Sep 17 17:14:28 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:28 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3.e8bc663e-6976-4918-8603-97090910519c" returned: 0 in 0.379s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-e8bc663e-6976-4918-8603-97090910519c" released by "_delete_snapshot" :: held 2.275s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-e11b709b-744d-4679-990f-3b9d552b6be3" released by "delete_snapshot" :: held 2.302s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Created reservations ['f9df4cd4-abd6-4817-8a46-01322f2c9627', '82ffc41e-2e86-4532-95be-e112e58b6dfc', '7b557f07-5e8d-4853-bff6-aaf23d55182d', '37832e6e-25b9-4e8b-b693-1f4fbbc1aa68'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:29 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Delete snapshot completed successfully. Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5e423462-3f23-4e50-8002-b4e30d11335e tempest-VolumeDependencyTests-659852635 None] Lock "cinder-e8bc663e-6976-4918-8603-97090910519c-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:29 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641" returned: 0 in 0.304s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.348s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=895e4740-139e-4f3c-a3c9-b6caac30c337,created_at=2026-09-17T15:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-200041406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=895e4740-139e-4f3c-a3c9-b6caac30c337,host='devstack@QuobyteHD#QuobyteHD',id=e28b28a9-f21b-4589-a38e-6961dfaa1b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c54b2d7ec9f492e977706780be5fa5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:29Z,use_quota=True,user_id='bc41e17122cb4fa3bdb548705a72da3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac622a3e-dde8-4ae8-b2f2-8c2678f067ac),volume_type_id=ac622a3e-dde8-4ae8-b2f2-8c2678f067ac)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Creating volume e28b28a9-f21b-4589-a38e-6961dfaa1b5a {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:14:29 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d66a83-2c67-491d-bac9-9f85867d7c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d39c001-39d1-41c0-a416-0696ae1fa641', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:29 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a 1073741824 Sep 17 17:14:29 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b67de1-bfac-498b-a98a-7ab82b0c1103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:29 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Volume volume-5d39c001-39d1-41c0-a416-0696ae1fa641 (5d39c001-39d1-41c0-a416-0696ae1fa641): created successfully Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b67de1-bfac-498b-a98a-7ab82b0c1103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Flow 'volume_create_manager' (ae471073-fc1e-49ae-983f-6f8250ff887b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:29 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1a1b6b33-c78c-4379-b1ae-753683c83608 tempest-TestInstancesWithCinderVolumes-318911255 None] Created volume successfully. Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:14:29 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Flow 'volume_create_manager' (b4480ce9-826d-4254-98fd-48532b9b50d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7563ba81-823e-401a-9719-46b3420ccb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a 1073741824" returned: 0 in 0.548s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7563ba81-823e-401a-9719-46b3420ccb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1607552275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb508081-9753-4920-9055-9af228038032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc939e43b04b4383a1aeecde02155f5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:30Z,use_quota=True,user_id='5b1516aaee1d44f28f6078d7d029eba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0948b4-2ba8-4b84-a0a7-b7b7da1dfc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0948b4-2ba8-4b84-a0a7-b7b7da1dfc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f507b878-f698-46d2-bfc1-b6f2502576da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f507b878-f698-46d2-bfc1-b6f2502576da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb508081-9753-4920-9055-9af228038032', 'volume_name': 'volume-cb508081-9753-4920-9055-9af228038032', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea37cbf7-3893-446e-b679-ea8e713b447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea37cbf7-3893-446e-b679-ea8e713b447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2fa048-f44d-4832-acc6-152321717bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:29 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Volume cb508081-9753-4920-9055-9af228038032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb508081-9753-4920-9055-9af228038032', 'volume_size': 1} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:29 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a Sep 17 17:14:29 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "cinder-e11b709b-744d-4679-990f-3b9d552b6be3-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-e11b709b-744d-4679-990f-3b9d552b6be3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "cinder-quobyte-e11b709b-744d-4679-990f-3b9d552b6be3" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-e11b709b-744d-4679-990f-3b9d552b6be3" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0f7581-7aa7-4282-b7d0-54940184c0bf]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:30 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a" returned: 0 in 0.313s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1607552275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb508081-9753-4920-9055-9af228038032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc939e43b04b4383a1aeecde02155f5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:30Z,use_quota=True,user_id='5b1516aaee1d44f28f6078d7d029eba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Creating volume cb508081-9753-4920-9055-9af228038032 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:14:30 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:30 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 Sep 17 17:14:30 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f13742-041b-438b-8ba8-616c150bf53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:30 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 1073741824 Sep 17 17:14:30 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a66192-6525-445f-a44c-bbdd597c179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Volume volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a (e28b28a9-f21b-4589-a38e-6961dfaa1b5a): created successfully Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a66192-6525-445f-a44c-bbdd597c179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Flow 'volume_create_manager' (3bbd16b2-8167-45e3-929d-9224dbdff5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-19f636cb-506d-4026-9e83-9d9fd0fb1a84 tempest-GroupsTest-475059644 None] Created volume successfully. Sep 17 17:14:30 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3" returned: 0 in 0.402s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:30 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3 Sep 17 17:14:30 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:30 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 1073741824" returned: 0 in 0.513s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:30 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 Sep 17 17:14:30 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:30 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e11b709b-744d-4679-990f-3b9d552b6be3" returned: 0 in 0.316s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-e11b709b-744d-4679-990f-3b9d552b6be3" released by "delete_volume" :: held 0.819s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:30 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Created reservations ['f3940099-2da0-497b-8350-94d7d0d1d6d8', 'dbb8c793-6319-4de7-b448-e31bb16e76f0', 'e8a59f07-9ad0-4e93-8cf0-0bcfebcf4eb1', '12a7b0e9-0d6a-45fe-8fce-e590a2f68780'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:31 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:14:31 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:31 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032" returned: 0 in 0.341s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2fa048-f44d-4832-acc6-152321717bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb508081-9753-4920-9055-9af228038032', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3273c72d-b7a9-487e-9526-9366d366b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:31 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Volume volume-cb508081-9753-4920-9055-9af228038032 (cb508081-9753-4920-9055-9af228038032): created successfully Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3273c72d-b7a9-487e-9526-9366d366b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Flow 'volume_create_manager' (b4480ce9-826d-4254-98fd-48532b9b50d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "cinder-570039dc-1b94-46a9-98ea-c8f6544a6f9d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-570039dc-1b94-46a9-98ea-c8f6544a6f9d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-2e6800d3-9c15-4fef-91eb-3f96b4e6d86a tempest-VolumesSnapshotListTestJSON-779710838 None] Created volume successfully. Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "cinder-quobyte-570039dc-1b94-46a9-98ea-c8f6544a6f9d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-570039dc-1b94-46a9-98ea-c8f6544a6f9d" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a9454b-1a7d-44bc-93ae-8e122b84f535]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:31 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-787059c6-2c8e-4c13-aafd-8678826f306a tempest-GroupsTest-475059644 None] Update group completed successfully. Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.387s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:14:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Deleted volume successfully. Sep 17 17:14:31 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d Sep 17 17:14:31 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b7e15ea8-7230-4b73-9546-44a3147f8411 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-e11b709b-744d-4679-990f-3b9d552b6be3-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:31 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d" returned: 0 in 0.454s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:31 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d Sep 17 17:14:31 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Creating offline snapshot c091b595-506b-4acf-a048-4a3f328eef45 of volume cb508081-9753-4920-9055-9af228038032 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:14:32 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-570039dc-1b94-46a9-98ea-c8f6544a6f9d" returned: 0 in 0.275s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e817257-c4fd-4fcb-9f9c-0e0d89408372]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-quobyte-570039dc-1b94-46a9-98ea-c8f6544a6f9d" released by "delete_volume" :: held 0.788s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Created reservations ['c3c0e8a4-00ce-4e23-aa0b-dbc11e384120', 'd8449ffc-9bae-4dc6-b055-6af88f881992', '5be22e90-3c64-4fc7-833d-b5b1683d3983', '4a68f204-c4d1-4268-94da-905786e32f9c'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:32 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 Sep 17 17:14:32 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:32 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:14:32 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:32 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032" returned: 0 in 0.447s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:32 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.311s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:14:32 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 1G Sep 17 17:14:32 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Deleted volume successfully. Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-61e2c88e-b275-472f-b1b8-1d457ca7e152 tempest-VolumeDependencyTests-659852635 None] Lock "cinder-570039dc-1b94-46a9-98ea-c8f6544a6f9d-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD, size 20.69 MB, duration 5.55 sec {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 17:14:32 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Image download 20.69 MB at 3.73 MB/s Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cea456b-c3cc-4429-9261-32e7bbbf5d16]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:32 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD Sep 17 17:14:32 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c43fb9d4-dfd8-4412-aafd-7b25d3042343 tempest-GroupsTest-475059644 None] Update group completed successfully. Sep 17 17:14:32 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 1G" returned: 0 in 0.489s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb508081-9753-4920-9055-9af228038032 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:33 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb508081-9753-4920-9055-9af228038032 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 Sep 17 17:14:33 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:33 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Temporary image 361e7547-55db-4a98-a576-1b70c305aa88 is fetched for user 2d271cea77ff4c43ac6322d060ecc411. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[de16cb30-7ad1-4353-9056-69b024c7432f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:33 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD Sep 17 17:14:33 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:33 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb508081-9753-4920-9055-9af228038032 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45" returned: 0 in 0.342s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:33 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 is being set with open permissions: ugo+rw Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:33 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 Sep 17 17:14:33 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:33 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:33 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45" returned: 0 in 0.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:33 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.info Sep 17 17:14:33 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.info" returned: 0 in 0.286s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:33 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.info is being set with open permissions: ugo+rw Sep 17 17:14:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:33 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:33 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.info Sep 17 17:14:33 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:34 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.info" returned: 0 in 0.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1478550935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381149aa-58ad-4345-8c58-09d550dd54b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9586d5a717bb4f5c9bffbd8c9a6aaeb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:14:26Z,use_quota=True,user_id='2d271cea77ff4c43ac6322d060ecc411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4229d2db-a991-47d5-9233-8c21b5c58b2e),volume_type_id=4229d2db-a991-47d5-9233-8c21b5c58b2e)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Creating volume 381149aa-58ad-4345-8c58-09d550dd54b2 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:14:34 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:34 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 1073741824 Sep 17 17:14:34 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bbe4ac83-781b-4651-8d44-b13a73eb43e6 tempest-VolumesSnapshotListTestJSON-779710838 None] Create snapshot completed successfully Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Acquiring lock "cinder-quobyte-968e9a3d-9ff5-4cab-9649-32616e840f45" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Lock "cinder-quobyte-968e9a3d-9ff5-4cab-9649-32616e840f45" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c7ecd5-8216-4ea7-9d15-956a2b3eea51]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:34 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 1073741824" returned: 0 in 0.564s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:34 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45 Sep 17 17:14:34 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:34 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 Sep 17 17:14:34 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:35 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45" returned: 0 in 0.425s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:35 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2" returned: 0 in 0.280s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:35 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45 Sep 17 17:14:35 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Attempting download of 361e7547-55db-4a98-a576-1b70c305aa88 ((None, [{'url': 'file:///opt/stack/data/glance/images/361e7547-55db-4a98-a576-1b70c305aa88', 'metadata': {}}])) to volume 381149aa-58ad-4345-8c58-09d550dd54b2. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52554a9-b54e-4985-bec7-fecf749c7124]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361e7547-55db-4a98-a576-1b70c305aa88_jnef2ojt {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:35 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361e7547-55db-4a98-a576-1b70c305aa88_jnef2ojt Sep 17 17:14:35 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:35 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-968e9a3d-9ff5-4cab-9649-32616e840f45" returned: 0 in 0.314s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Lock "cinder-quobyte-968e9a3d-9ff5-4cab-9649-32616e840f45" released by "delete_volume" :: held 0.796s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Acquiring lock "cinder-quobyte-e28b28a9-f21b-4589-a38e-6961dfaa1b5a" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] Creating offline snapshot 83e09f55-9656-443e-b4f0-9f54a8c65f3e of volume cb508081-9753-4920-9055-9af228038032 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Lock "cinder-quobyte-e28b28a9-f21b-4589-a38e-6961dfaa1b5a" acquired by "delete_volume" :: waited 0.067s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b548d8-92ea-4825-a03c-097addab9a90]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b5e0c3-fdde-4c59-be3a-93fe7701484f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:35 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 Sep 17 17:14:35 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:35 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_361e7547-55db-4a98-a576-1b70c305aa88_jnef2ojt" returned: 0 in 0.482s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361e7547-55db-4a98-a576-1b70c305aa88_jnef2ojt {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:35 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a Sep 17 17:14:35 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:35 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361e7547-55db-4a98-a576-1b70c305aa88_jnef2ojt Sep 17 17:14:35 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:35 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45" returned: 0 in 0.446s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb508081-9753-4920-9055-9af228038032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:14:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:36 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e 1G Sep 17 17:14:36 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:36 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a" returned: 0 in 0.491s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:36 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a Sep 17 17:14:36 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:36 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361e7547-55db-4a98-a576-1b70c305aa88_jnef2ojt" returned: 1 in 0.539s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_361e7547-55db-4a98-a576-1b70c305aa88_jnef2ojt' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb3936c-3e33-4d2f-97e5-ca6cf79ee965]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:36 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-e28b28a9-f21b-4589-a38e-6961dfaa1b5a" returned: 0 in 0.365s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:36 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD Sep 17 17:14:36 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Lock "cinder-quobyte-e28b28a9-f21b-4589-a38e-6961dfaa1b5a" released by "delete_volume" :: held 0.929s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Created reservations ['c18aa2e1-0737-4a94-b761-30b036b3c780'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:36 devstack cinder-volume[85889]: WARNING cinder.quota [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1436594810 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1436594810, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:14:36 devstack cinder-volume[85889]: WARNING cinder.quota [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1436594810 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1436594810, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:14:36 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e 1G" returned: 0 in 0.629s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Created reservations ['747a207a-0412-4f6e-80ec-302f91b045c9', 'cc709493-8b77-4d57-96ac-1ad8095e56b0', '4e8b2671-76be-4010-8baf-b48bacf68796', '04670bbf-6cc9-4f8f-98de-7551f9f97441'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:36 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e Sep 17 17:14:36 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:36 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] 361e7547-55db-4a98-a576-1b70c305aa88 was qcow2, converting to qcow2 {{(pid=85889) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:36 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 Sep 17 17:14:36 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:36 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Created reservations ['ce7b4e1a-9920-497c-9c49-38d0243edd8d', 'cfa38234-b80f-431b-95af-3af409797a87', '5b831b57-7822-41d6-9e7b-8035f29ffcfc', 'e225a338-21e4-4744-94db-63ddab055179'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:37 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e" returned: 0 in 0.420s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:37 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e is being set with open permissions: ugo+rw Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:37 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:14:37 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:37 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e Sep 17 17:14:37 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:37 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e" returned: 0 in 0.378s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:37 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.410s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:14:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-673450ad-ff3c-4e5e-b540-58cb9ccd4e68 tempest-GroupsTest-475059644 None] Delete group completed successfully. Sep 17 17:14:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0719c2c6-8eee-4dcf-9ce8-0fc1924305d5 tempest-VolumesSnapshotListTestJSON-779710838 None] Create snapshot completed successfully Sep 17 17:14:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] Creating offline snapshot 9127c749-4325-46c6-aa5d-dba44bc6e946 of volume cb508081-9753-4920-9055-9af228038032 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:14:38 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecd9229-a7e3-4d88-a81a-d12fb9ddb9da]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:39 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e Sep 17 17:14:39 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:39 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2" returned: 0 in 2.438s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_361e7547-55db-4a98-a576-1b70c305aa88_zmbxknvxdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:14:39 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Converted 112.00 MB image at 45.89 MB/s Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:39 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 1G Sep 17 17:14:39 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:39 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e" returned: 0 in 0.510s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb508081-9753-4920-9055-9af228038032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:39 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 1G Sep 17 17:14:39 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:39 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 1G" returned: 0 in 0.486s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Downloaded image 361e7547-55db-4a98-a576-1b70c305aa88 ((None, [{'url': 'file:///opt/stack/data/glance/images/361e7547-55db-4a98-a576-1b70c305aa88', 'metadata': {}}])) to volume 381149aa-58ad-4345-8c58-09d550dd54b2 successfully. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Temporary image 361e7547-55db-4a98-a576-1b70c305aa88 for user 2d271cea77ff4c43ac6322d060ecc411 is deleted. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Marking volume 381149aa-58ad-4345-8c58-09d550dd54b2 as bootable. {{(pid=85889) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Copying metadata from image 361e7547-55db-4a98-a576-1b70c305aa88 to 381149aa-58ad-4345-8c58-09d550dd54b2. {{(pid=85889) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Creating volume glance metadata for volume 381149aa-58ad-4345-8c58-09d550dd54b2 backed by image 361e7547-55db-4a98-a576-1b70c305aa88 with: {'image_id': '361e7547-55db-4a98-a576-1b70c305aa88', 'image_name': 'tempest-scenario-img--2121874887', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85889) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fec717-a420-4d29-894b-3d6ce943d419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-381149aa-58ad-4345-8c58-09d550dd54b2', 'volume_size': 1, 'image_id': '361e7547-55db-4a98-a576-1b70c305aa88', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/361e7547-55db-4a98-a576-1b70c305aa88', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2121874887', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9586d5a717bb4f5c9bffbd8c9a6aaeb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '361e7547-55db-4a98-a576-1b70c305aa88', 'created_at': datetime.datetime(2026, 9, 17, 15, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 14, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/361e7547-55db-4a98-a576-1b70c305aa88/file', 'properties': {}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973cb696-c953-47b6-8406-e84be7e47334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:14:39 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Volume volume-381149aa-58ad-4345-8c58-09d550dd54b2 (381149aa-58ad-4345-8c58-09d550dd54b2): created successfully Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973cb696-c953-47b6-8406-e84be7e47334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:14:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Flow 'volume_create_manager' (dcfb9964-9113-4446-aa56-2b1409015dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:14:39 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e148b1bc-3aeb-4da2-a279-9d720b114ce4 tempest-TestInstancesWithCinderVolumes-318911255 None] Created volume successfully. Sep 17 17:14:40 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 1G" returned: 0 in 0.638s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:40 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 Sep 17 17:14:40 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:40 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946" returned: 0 in 0.377s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:40 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 is being set with open permissions: ugo+rw Sep 17 17:14:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:40 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 Sep 17 17:14:40 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:40 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946" returned: 0 in 0.343s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7ae9aa35-c943-425f-94d7-63dc077c94ed tempest-VolumesSnapshotListTestJSON-779710838 None] Create snapshot completed successfully Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-9127c749-4325-46c6-aa5d-dba44bc6e946-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-9127c749-4325-46c6-aa5d-dba44bc6e946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-quobyte-9127c749-4325-46c6-aa5d-dba44bc6e946" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-9127c749-4325-46c6-aa5d-dba44bc6e946" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Deleting offline snapshot 9127c749-4325-46c6-aa5d-dba44bc6e946 of volume cb508081-9753-4920-9055-9af228038032 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] snapshot_file for this snap is: volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a607e11-1c86-4dd5-b882-1907175dfd86]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:42 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 Sep 17 17:14:42 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:42 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946" returned: 0 in 0.481s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb508081-9753-4920-9055-9af228038032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d13547-8926-4292-b653-0863745b8d46]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:43 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e Sep 17 17:14:43 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:43 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e" returned: 0 in 0.584s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb508081-9753-4920-9055-9af228038032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:14:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:43 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 Sep 17 17:14:43 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=164,cinder:UPDATE=211,cinder:INSERT=53,cinder:DELETE=21 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=167,cinder:UPDATE=204,cinder:INSERT=54,cinder:DELETE=12 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6d2ad335-8788-4b48-99d6-cc6345c16127 req-98c80b93-ee5e-4bcc-88ed-5b28cff9718d tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6d2ad335-8788-4b48-99d6-cc6345c16127 req-98c80b93-ee5e-4bcc-88ed-5b28cff9718d tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:44 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6d2ad335-8788-4b48-99d6-cc6345c16127 req-98c80b93-ee5e-4bcc-88ed-5b28cff9718d tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946" returned: 0 in 0.622s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:44 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946 Sep 17 17:14:44 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-6d2ad335-8788-4b48-99d6-cc6345c16127 req-98c80b93-ee5e-4bcc-88ed-5b28cff9718d tempest-TestInstancesWithCinderVolumes-318911255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-381149aa-58ad-4345-8c58-09d550dd54b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '498d91a2-bd3b-4c01-ad0f-91342c0859bb', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:14:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-6d2ad335-8788-4b48-99d6-cc6345c16127 req-98c80b93-ee5e-4bcc-88ed-5b28cff9718d tempest-TestInstancesWithCinderVolumes-318911255 None] attachment_update completed successfully. Sep 17 17:14:44 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.9127c749-4325-46c6-aa5d-dba44bc6e946" returned: 0 in 0.409s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-9127c749-4325-46c6-aa5d-dba44bc6e946" released by "_delete_snapshot" :: held 2.246s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" released by "delete_snapshot" :: held 2.275s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Created reservations ['02cc32ee-827e-45c6-83ad-584e76307f32', '18068cc2-8e7d-4013-bec0-870b97e53778', '951ee03b-2a34-4b54-b80a-9da998204853', '8aca8954-1565-431d-a577-c44995882c9c'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Delete snapshot completed successfully. Sep 17 17:14:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-29815207-e8b3-4e2a-9339-6efa8f41afca tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-9127c749-4325-46c6-aa5d-dba44bc6e946-delete_snapshot" released by "delete_snapshot" :: held 2.585s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-83e09f55-9656-443e-b4f0-9f54a8c65f3e-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-83e09f55-9656-443e-b4f0-9f54a8c65f3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-quobyte-83e09f55-9656-443e-b4f0-9f54a8c65f3e" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-83e09f55-9656-443e-b4f0-9f54a8c65f3e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Deleting offline snapshot 83e09f55-9656-443e-b4f0-9f54a8c65f3e of volume cb508081-9753-4920-9055-9af228038032 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:14:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] snapshot_file for this snap is: volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:14:45 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e47481-c600-4d37-b466-a69dbd762e1f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:45 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e Sep 17 17:14:45 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:46 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e" returned: 0 in 0.399s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb508081-9753-4920-9055-9af228038032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:14:46 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e721209-2c41-435d-876b-5d83627944e2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:46 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 Sep 17 17:14:46 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:46 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45" returned: 0 in 0.561s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb508081-9753-4920-9055-9af228038032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:14:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:46 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e Sep 17 17:14:46 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:47 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e" returned: 0 in 0.587s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:47 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e Sep 17 17:14:47 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:47 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.83e09f55-9656-443e-b4f0-9f54a8c65f3e" returned: 0 in 0.600s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-83e09f55-9656-443e-b4f0-9f54a8c65f3e" released by "_delete_snapshot" :: held 2.306s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" released by "delete_snapshot" :: held 2.337s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:48 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Created reservations ['2ee7f248-8f9c-42f5-b0eb-4801c1b63055', '782412ee-a128-4628-9854-2612fabd67d7', 'ef826e52-ea59-4aae-b482-22c61b7ba47c', '22bf8f29-3d14-497d-8d73-83321fe5e151'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:48 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Delete snapshot completed successfully. Sep 17 17:14:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7c17f188-2b33-46d0-98d0-a2b146cfdf4a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-83e09f55-9656-443e-b4f0-9f54a8c65f3e-delete_snapshot" released by "delete_snapshot" :: held 2.591s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-c091b595-506b-4acf-a048-4a3f328eef45-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-c091b595-506b-4acf-a048-4a3f328eef45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" acquired by "delete_snapshot" :: waited 0.043s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-quobyte-c091b595-506b-4acf-a048-4a3f328eef45" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-c091b595-506b-4acf-a048-4a3f328eef45" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Deleting offline snapshot c091b595-506b-4acf-a048-4a3f328eef45 of volume cb508081-9753-4920-9055-9af228038032 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:14:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] snapshot_file for this snap is: volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:14:49 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7d19c4-1315-48cd-b16f-4fa9d0466764]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:49 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 Sep 17 17:14:49 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:49 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45" returned: 0 in 0.450s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb508081-9753-4920-9055-9af228038032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:14:49 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[55126565-0d57-46cb-9feb-42a39c69f591]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:49 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 Sep 17 17:14:49 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:50 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032" returned: 0 in 0.546s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:50 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 Sep 17 17:14:50 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:50 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45" returned: 0 in 0.487s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:50 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45 Sep 17 17:14:50 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:50 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032.c091b595-506b-4acf-a048-4a3f328eef45" returned: 0 in 0.296s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-c091b595-506b-4acf-a048-4a3f328eef45" released by "_delete_snapshot" :: held 1.931s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" released by "delete_snapshot" :: held 1.963s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:51 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Created reservations ['9e124796-3362-4dc3-8aeb-dd71e6ae4f10', '8ee226e9-f9f6-49ee-bfd8-f15bab506bf9', '84787810-5ad4-44a8-a3ce-5036c626e5f9', '6b8bf3b1-6641-4546-acc2-17db122cd64e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Delete snapshot completed successfully. Sep 17 17:14:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-493b8bff-47f8-4ffe-91fb-5123f72d554f tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-c091b595-506b-4acf-a048-4a3f328eef45-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-cb508081-9753-4920-9055-9af228038032-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-cb508081-9753-4920-9055-9af228038032-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:14:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" acquired by "delete_volume" :: waited 0.037s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:14:52 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d4584-f6f3-4fc2-8c1a-4ea2ce7ebd5d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:14:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:52 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 Sep 17 17:14:52 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:53 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032" returned: 0 in 0.644s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:53 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032 Sep 17 17:14:53 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:53 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-cb508081-9753-4920-9055-9af228038032" returned: 0 in 0.519s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-quobyte-cb508081-9753-4920-9055-9af228038032" released by "delete_volume" :: held 1.297s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Created reservations ['798d03cf-84a7-4a11-9e3c-d41557a6709d', 'f9ab9764-a0b2-4a5f-905c-e866eb605616', '54391da9-32c7-4e3b-9938-d6d9508f3418', '94e047a8-cde4-40f4-a3c0-48e1fa6f1715'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:14:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:14:54 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:14:54 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:14:54 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 17 17:14:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.545s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:14:54 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:14:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Deleted volume successfully. Sep 17 17:14:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-588db57e-882b-4419-865d-9cb4dfb4a03a tempest-VolumesSnapshotListTestJSON-779710838 None] Lock "cinder-cb508081-9753-4920-9055-9af228038032-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:06 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=29,cinder:SELECT=18,cinder:INSERT=9 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:15:06 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=33,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Flow 'volume_create_manager' (c09fb5f0-13ac-48bf-a9f6-4298eae7eaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51116f79-1947-4c63-840f-a5434e79f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51116f79-1947-4c63-840f-a5434e79f791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-951938452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f00ce07-dccf-4b75-be14-3cecf2af74bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bd281265e43f783a3b9b035f257a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:12Z,use_quota=True,user_id='a977f7dd81924d87ba70b9fde567f1f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1df84fb6-3618-456d-8f74-322e3bcbf2f0),volume_type_id=1df84fb6-3618-456d-8f74-322e3bcbf2f0)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90055dc-08b7-4c30-a19b-8ac6502e71f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90055dc-08b7-4c30-a19b-8ac6502e71f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3c5960-b45b-4f96-b6ab-82634646e6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3c5960-b45b-4f96-b6ab-82634646e6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f00ce07-dccf-4b75-be14-3cecf2af74bf', 'volume_name': 'volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0758a821-f58c-420a-87a8-4c6236dc4278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0758a821-f58c-420a-87a8-4c6236dc4278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9971f3f5-ea52-4abd-832c-91a3312357c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:12 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Volume 8f00ce07-dccf-4b75-be14-3cecf2af74bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf', 'volume_size': 1} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-951938452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f00ce07-dccf-4b75-be14-3cecf2af74bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bd281265e43f783a3b9b035f257a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:12Z,use_quota=True,user_id='a977f7dd81924d87ba70b9fde567f1f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1df84fb6-3618-456d-8f74-322e3bcbf2f0),volume_type_id=1df84fb6-3618-456d-8f74-322e3bcbf2f0)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Creating volume 8f00ce07-dccf-4b75-be14-3cecf2af74bf {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:15:12 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:15:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:12 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf 1073741824 Sep 17 17:15:12 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:13 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf 1073741824" returned: 0 in 0.478s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:13 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf Sep 17 17:15:13 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:13 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf" returned: 0 in 0.267s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:15:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9971f3f5-ea52-4abd-832c-91a3312357c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323dab40-1f47-4772-ac2f-872c8cc06980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:13 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Volume volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf (8f00ce07-dccf-4b75-be14-3cecf2af74bf): created successfully Sep 17 17:15:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323dab40-1f47-4772-ac2f-872c8cc06980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Flow 'volume_create_manager' (c09fb5f0-13ac-48bf-a9f6-4298eae7eaa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f228617f-3891-4e06-9f2f-1d46a590eab5 tempest-VolumeTypesAccessTest-74963670 None] Created volume successfully. Sep 17 17:15:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Acquiring lock "cinder-8f00ce07-dccf-4b75-be14-3cecf2af74bf-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Lock "cinder-8f00ce07-dccf-4b75-be14-3cecf2af74bf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Acquiring lock "cinder-quobyte-8f00ce07-dccf-4b75-be14-3cecf2af74bf" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Lock "cinder-quobyte-8f00ce07-dccf-4b75-be14-3cecf2af74bf" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26771b0-74c4-4e50-a1a0-21201313b3d1]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:15:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:14 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf Sep 17 17:15:14 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:15 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf" returned: 0 in 0.401s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:15 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf Sep 17 17:15:15 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:15 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8f00ce07-dccf-4b75-be14-3cecf2af74bf" returned: 0 in 0.260s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Lock "cinder-quobyte-8f00ce07-dccf-4b75-be14-3cecf2af74bf" released by "delete_volume" :: held 0.719s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:15 devstack cinder-volume[85889]: WARNING cinder.quota [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-729265059 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-729265059, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:15:15 devstack cinder-volume[85889]: WARNING cinder.quota [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-729265059 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-729265059, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Created reservations ['a9312e96-92a7-4899-82e8-e63f2b743395', '6645a0c7-501a-457f-aa60-cbfd037304fd', '6106e591-2b2f-4d8b-8809-fa868f9bba2c', '77202fc7-065c-457a-9a66-51e12c19fb68'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:15 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:15:15 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:16 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.415s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:16 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:15:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Deleted volume successfully. Sep 17 17:15:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc6e748e-fdd9-46ce-a0af-5a23bfb4e183 tempest-VolumeTypesAccessTest-74963670 None] Lock "cinder-8f00ce07-dccf-4b75-be14-3cecf2af74bf-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-3308cd41-17a6-4bec-9de6-4f08eb7aeede req-875f88f6-852b-4f06-acd3-12c883584158 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-3308cd41-17a6-4bec-9de6-4f08eb7aeede req-875f88f6-852b-4f06-acd3-12c883584158 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-3308cd41-17a6-4bec-9de6-4f08eb7aeede req-875f88f6-852b-4f06-acd3-12c883584158 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:19 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-3308cd41-17a6-4bec-9de6-4f08eb7aeede req-875f88f6-852b-4f06-acd3-12c883584158 tempest-TestInstancesWithCinderVolumes-318911255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-48dc92a6-b532-49bc-823e-ad88c39a7477', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85a73d0d-0e27-4a2d-8ed5-6fa7f3ec197f', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:15:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-3308cd41-17a6-4bec-9de6-4f08eb7aeede req-875f88f6-852b-4f06-acd3-12c883584158 tempest-TestInstancesWithCinderVolumes-318911255 None] attachment_update completed successfully. Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:22 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:15:22 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:22 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.419s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-56ea902c-f11b-48b2-a225-f281f56f3579 req-e5cf0eca-6552-41e9-b187-955bf19e6463 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-56ea902c-f11b-48b2-a225-f281f56f3579 req-e5cf0eca-6552-41e9-b187-955bf19e6463 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-56ea902c-f11b-48b2-a225-f281f56f3579 req-e5cf0eca-6552-41e9-b187-955bf19e6463 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-56ea902c-f11b-48b2-a225-f281f56f3579 req-e5cf0eca-6552-41e9-b187-955bf19e6463 tempest-TestInstancesWithCinderVolumes-318911255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-5d39c001-39d1-41c0-a416-0696ae1fa641', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f61e09d0-9da6-4482-86f6-f606a663a3cd', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:15:22 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-56ea902c-f11b-48b2-a225-f281f56f3579 req-e5cf0eca-6552-41e9-b187-955bf19e6463 tempest-TestInstancesWithCinderVolumes-318911255 None] attachment_update completed successfully. Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Flow 'volume_create_manager' (28a7e62a-ed0c-4d2a-a5e6-ec5d635c34cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0926d155-3ea1-4d18-a31d-89e723c814fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0926d155-3ea1-4d18-a31d-89e723c814fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-534532947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12aeb61-d2a3-48c5-bc0a-0225d8310554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d62a439d4d4631b3e2ea273a5a4ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:28Z,use_quota=True,user_id='3c515f2c7c794b11bd8348c06435f763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49426ea7-ede7-43d3-822b-11377ed53761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49426ea7-ede7-43d3-822b-11377ed53761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470d380c-a23e-4e61-961d-d62402197faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470d380c-a23e-4e61-961d-d62402197faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd12aeb61-d2a3-48c5-bc0a-0225d8310554', 'volume_name': 'volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3069054a-cbab-4f68-909a-ec095228024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3069054a-cbab-4f68-909a-ec095228024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884d1c4f-d579-4111-8cd4-afe110b2b7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:27 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Volume d12aeb61-d2a3-48c5-bc0a-0225d8310554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554', 'volume_size': 1} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-534532947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12aeb61-d2a3-48c5-bc0a-0225d8310554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d62a439d4d4631b3e2ea273a5a4ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:28Z,use_quota=True,user_id='3c515f2c7c794b11bd8348c06435f763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Creating volume d12aeb61-d2a3-48c5-bc0a-0225d8310554 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:15:27 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:15:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:27 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554 1073741824 Sep 17 17:15:27 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:28 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554 1073741824" returned: 0 in 0.545s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:28 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554 Sep 17 17:15:28 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:28 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554" returned: 0 in 0.456s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:28 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:15:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884d1c4f-d579-4111-8cd4-afe110b2b7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07f3047-a335-49a9-8fe4-8ff0f688c69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:28 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Volume volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554 (d12aeb61-d2a3-48c5-bc0a-0225d8310554): created successfully Sep 17 17:15:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07f3047-a335-49a9-8fe4-8ff0f688c69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Flow 'volume_create_manager' (28a7e62a-ed0c-4d2a-a5e6-ec5d635c34cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:28 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-416d42cf-c6ae-4d9f-8a87-0f6402162d0e tempest-VolumesMetadataTest-941257439 None] Created volume successfully. Sep 17 17:15:29 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-4eeaac82-2f50-4ace-b3b5-be6cfdc4d32e req-677b1701-697b-466c-b3e0-fbdb01950fa7 tempest-TestInstancesWithCinderVolumes-318911255 None] Terminate volume connection completed successfully. Sep 17 17:15:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-4eeaac82-2f50-4ace-b3b5-be6cfdc4d32e req-677b1701-697b-466c-b3e0-fbdb01950fa7 tempest-TestInstancesWithCinderVolumes-318911255 None] Deleting attachment 85a73d0d-0e27-4a2d-8ed5-6fa7f3ec197f. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "cinder-48dc92a6-b532-49bc-823e-ad88c39a7477-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-48dc92a6-b532-49bc-823e-ad88c39a7477-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "cinder-quobyte-48dc92a6-b532-49bc-823e-ad88c39a7477" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-quobyte-48dc92a6-b532-49bc-823e-ad88c39a7477" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Acquiring lock "cinder-d12aeb61-d2a3-48c5-bc0a-0225d8310554-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[638098d1-760a-4d13-a743-466fdd506ea7]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Lock "cinder-d12aeb61-d2a3-48c5-bc0a-0225d8310554-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Acquiring lock "cinder-quobyte-d12aeb61-d2a3-48c5-bc0a-0225d8310554" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Lock "cinder-quobyte-d12aeb61-d2a3-48c5-bc0a-0225d8310554" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc391a9e-f708-4935-b902-916d95db075b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:15:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:30 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477 Sep 17 17:15:30 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:31 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554 Sep 17 17:15:31 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:31 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:31 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477" returned: 0 in 1.061s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554" returned: 0 in 0.825s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:31 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477 Sep 17 17:15:31 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:31 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554 Sep 17 17:15:31 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:32 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d12aeb61-d2a3-48c5-bc0a-0225d8310554" returned: 0 in 0.543s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Lock "cinder-quobyte-d12aeb61-d2a3-48c5-bc0a-0225d8310554" released by "delete_volume" :: held 1.516s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:32 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48dc92a6-b532-49bc-823e-ad88c39a7477" returned: 0 in 0.673s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-quobyte-48dc92a6-b532-49bc-823e-ad88c39a7477" released by "delete_volume" :: held 1.806s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Created reservations ['0911399a-d329-43f7-945d-f7751b8e9b5b', '149a1a16-7df5-42d2-84b0-0037ab89fdf5', '7fc5c1fd-9070-420b-8886-20664b859341', '13f45279-26d4-4735-83b7-0ba8f73b12d0'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:15:32 devstack cinder-volume[85889]: WARNING cinder.quota [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-914339470-1406439328 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-914339470-1406439328, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:15:32 devstack cinder-volume[85889]: WARNING cinder.quota [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-914339470-1406439328 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-914339470-1406439328, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Created reservations ['84844f93-90ef-4511-98db-72bf43c4cfa8', '40b4d19f-5c1b-471e-8148-7b5908cd7d0e', '6ebcd48d-ac9f-4453-a5f9-3d9dd8fe30ff', '8c055a62-5dcd-4371-95eb-241c2aeb4f31'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:32 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:15:32 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:32 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:15:32 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:32 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.367s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:15:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Deleted volume successfully. Sep 17 17:15:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d25c8ab-d75b-4b3f-88af-272ed929ce7d tempest-VolumesMetadataTest-941257439 None] Lock "cinder-d12aeb61-d2a3-48c5-bc0a-0225d8310554-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:33 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.538s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:33 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:15:33 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Deleted volume successfully. Sep 17 17:15:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-69d11951-1808-4dc4-9096-6860f346ab2f tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-48dc92a6-b532-49bc-823e-ad88c39a7477-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:36 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-61f8e1f6-0e5b-48a9-a06f-9f0565aff3cf req-fb04252c-50a0-4666-bc83-3f7a03727d3e tempest-TestInstancesWithCinderVolumes-318911255 None] Terminate volume connection completed successfully. Sep 17 17:15:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-61f8e1f6-0e5b-48a9-a06f-9f0565aff3cf req-fb04252c-50a0-4666-bc83-3f7a03727d3e tempest-TestInstancesWithCinderVolumes-318911255 None] Deleting attachment f61e09d0-9da6-4482-86f6-f606a663a3cd. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:15:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "cinder-5d39c001-39d1-41c0-a416-0696ae1fa641-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-5d39c001-39d1-41c0-a416-0696ae1fa641-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "cinder-quobyte-5d39c001-39d1-41c0-a416-0696ae1fa641" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-quobyte-5d39c001-39d1-41c0-a416-0696ae1fa641" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:37 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e993b0c6-765f-4e05-abd9-a2f47a72c9d4]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:15:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:37 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641 Sep 17 17:15:37 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:37 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641" returned: 0 in 0.426s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:37 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641 Sep 17 17:15:37 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:37 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5d39c001-39d1-41c0-a416-0696ae1fa641" returned: 0 in 0.407s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-quobyte-5d39c001-39d1-41c0-a416-0696ae1fa641" released by "delete_volume" :: held 0.901s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:37 devstack cinder-volume[85889]: WARNING cinder.quota [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2072302911-1002275547 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2072302911-1002275547, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:15:37 devstack cinder-volume[85889]: WARNING cinder.quota [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2072302911-1002275547 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2072302911-1002275547, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:15:37 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Created reservations ['9ee90415-3145-4cd5-b831-b2334e7f92fa', '70d59abe-f03b-4736-96f4-5f62d841442f', '60e68132-4900-48d9-b7a8-54b784b32b61', '70337403-6ef6-4250-9380-f190eba92b20'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (56a7de6e-9dfe-41dd-a8ba-47293a42cd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39eea35-c1bb-4f9b-9f87-ae9f656d784b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39eea35-c1bb-4f9b-9f87-ae9f656d784b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-811740144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c87ce85-8251-4c7d-b51b-3504a5b0f934,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:38Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3dd5ed-80b1-4784-99b6-c96f38ba7d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3dd5ed-80b1-4784-99b6-c96f38ba7d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d47d73-eb60-4f05-8cf0-e0a97e51f8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d47d73-eb60-4f05-8cf0-e0a97e51f8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c87ce85-8251-4c7d-b51b-3504a5b0f934', 'volume_name': 'volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ae03d4-5a88-43cd-8da3-a671c5326384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ae03d4-5a88-43cd-8da3-a671c5326384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd101891-d992-4a43-a79c-4b263b4b7f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:38 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Volume 0c87ce85-8251-4c7d-b51b-3504a5b0f934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934', 'volume_size': 1} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-811740144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c87ce85-8251-4c7d-b51b-3504a5b0f934,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:38Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Creating volume 0c87ce85-8251-4c7d-b51b-3504a5b0f934 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:15:38 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:38 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934 1073741824 Sep 17 17:15:38 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:38 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:15:38 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:38 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.428s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:15:38 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Deleted volume successfully. Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9824c9-4fb4-481e-84d6-06263c0efa59 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-5d39c001-39d1-41c0-a416-0696ae1fa641-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:38 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934 1073741824" returned: 0 in 0.642s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:38 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934 Sep 17 17:15:38 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:39 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934" returned: 0 in 0.376s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:15:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd101891-d992-4a43-a79c-4b263b4b7f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8004dcfe-73a5-48ae-ac59-5a22161d4bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:39 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Volume volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934 (0c87ce85-8251-4c7d-b51b-3504a5b0f934): created successfully Sep 17 17:15:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8004dcfe-73a5-48ae-ac59-5a22161d4bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (56a7de6e-9dfe-41dd-a8ba-47293a42cd36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:39 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-de622e07-39ba-4509-ac62-80915555c3df tempest-VolumesGetTest-482053923 None] Created volume successfully. Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (c156d779-3496-4add-89b8-15876d7cc231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14942350-7306-4168-a761-b933ca7d19ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14942350-7306-4168-a761-b933ca7d19ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-996310847',display_name='tempest-VolumesGetTest-Volume-2052197779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7d320a-846e-4595-8f13-8925a4079288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:42Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3914a49-aff2-4d19-ac98-07a203cef193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3914a49-aff2-4d19-ac98-07a203cef193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9099aea1-e695-4303-af84-8665ee682a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9099aea1-e695-4303-af84-8665ee682a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7d320a-846e-4595-8f13-8925a4079288', 'volume_name': 'volume-5f7d320a-846e-4595-8f13-8925a4079288', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddf46e7-9aa4-48ad-9470-cbad95745a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddf46e7-9aa4-48ad-9470-cbad95745a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e203e6e0-2ba9-4dcc-a987-4299e001e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:41 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Volume 5f7d320a-846e-4595-8f13-8925a4079288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7d320a-846e-4595-8f13-8925a4079288', 'volume_size': 1} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-996310847',display_name='tempest-VolumesGetTest-Volume-2052197779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7d320a-846e-4595-8f13-8925a4079288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:42Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Creating volume 5f7d320a-846e-4595-8f13-8925a4079288 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:15:41 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:41 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288 1073741824 Sep 17 17:15:41 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-d9f09813-e3d5-4ed0-83b3-0e90e3ce52a4 req-abffa3e3-1aa5-4a90-8c86-bd38440ad66f tempest-TestInstancesWithCinderVolumes-318911255 None] Terminate volume connection completed successfully. Sep 17 17:15:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-d9f09813-e3d5-4ed0-83b3-0e90e3ce52a4 req-abffa3e3-1aa5-4a90-8c86-bd38440ad66f tempest-TestInstancesWithCinderVolumes-318911255 None] Deleting attachment 498d91a2-bd3b-4c01-ad0f-91342c0859bb. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:15:42 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288 1073741824" returned: 0 in 0.569s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:42 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288 Sep 17 17:15:42 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:42 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288" returned: 0 in 0.280s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e203e6e0-2ba9-4dcc-a987-4299e001e170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7d320a-846e-4595-8f13-8925a4079288', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bea062-386a-4371-b966-313417c0500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:42 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Volume volume-5f7d320a-846e-4595-8f13-8925a4079288 (5f7d320a-846e-4595-8f13-8925a4079288): created successfully Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bea062-386a-4371-b966-313417c0500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (c156d779-3496-4add-89b8-15876d7cc231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:42 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-931d77d8-2afd-4a0f-8447-cd482b7b3f10 tempest-VolumesGetTest-482053923 None] Created volume successfully. Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "cinder-381149aa-58ad-4345-8c58-09d550dd54b2-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-381149aa-58ad-4345-8c58-09d550dd54b2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "cinder-quobyte-381149aa-58ad-4345-8c58-09d550dd54b2" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-quobyte-381149aa-58ad-4345-8c58-09d550dd54b2" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[415e80dd-84db-4188-8fb4-34ab2504e23a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:43 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 Sep 17 17:15:43 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:43 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2" returned: 0 in 0.390s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:43 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2 Sep 17 17:15:43 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:43 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-381149aa-58ad-4345-8c58-09d550dd54b2" returned: 0 in 0.258s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-quobyte-381149aa-58ad-4345-8c58-09d550dd54b2" released by "delete_volume" :: held 0.706s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:43 devstack cinder-volume[85889]: WARNING cinder.quota [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1314114639-2114570698 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1314114639-2114570698, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:15:43 devstack cinder-volume[85889]: WARNING cinder.quota [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1314114639-2114570698 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1314114639-2114570698, it is now deprecated. Please use the default quota class for default quota. Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Created reservations ['62e03ebf-3be9-48dc-9a8c-414e2cf9b590', '4278cc12-ab91-43ff-87c2-9db78b7c6171', '646f2a62-fae1-402c-ba27-c168ae0d611d', 'e8a923bb-c169-4a32-af91-e6a3ea8c3da3'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:43 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:15:43 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-5f7d320a-846e-4595-8f13-8925a4079288-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Lock "cinder-5f7d320a-846e-4595-8f13-8925a4079288-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-quobyte-5f7d320a-846e-4595-8f13-8925a4079288" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-5f7d320a-846e-4595-8f13-8925a4079288" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d443ac86-efd1-4b10-8233-dfa61ba38cf7]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:44 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.302s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:15:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Deleted volume successfully. Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2e9180e-3291-4d0c-a2a3-4abb21dc1242 tempest-TestInstancesWithCinderVolumes-318911255 None] Lock "cinder-381149aa-58ad-4345-8c58-09d550dd54b2-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:44 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288 Sep 17 17:15:44 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:44 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288" returned: 0 in 0.474s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:44 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288 Sep 17 17:15:44 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:44 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5f7d320a-846e-4595-8f13-8925a4079288" returned: 0 in 0.276s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-5f7d320a-846e-4595-8f13-8925a4079288" released by "delete_volume" :: held 0.825s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Created reservations ['c82bbd38-f185-4996-abf0-d8f202fedf9a', '5181bcfb-7ab7-4b29-a5ab-e45afc140277', '3e9789c1-97a1-47d9-85cb-f5d130f89630', '47307f75-380c-46e4-89cb-ab1db514e1e7'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:44 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:15:44 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-0c87ce85-8251-4c7d-b51b-3504a5b0f934-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Lock "cinder-0c87ce85-8251-4c7d-b51b-3504a5b0f934-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:45 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.349s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:15:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Deleted volume successfully. Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-quobyte-0c87ce85-8251-4c7d-b51b-3504a5b0f934" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-0c87ce85-8251-4c7d-b51b-3504a5b0f934" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ed334147-727e-4652-bfbb-e8ba9a26316d tempest-VolumesGetTest-482053923 None] Lock "cinder-5f7d320a-846e-4595-8f13-8925a4079288-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa02cf78-bfdb-4445-9e28-6bf206b90d03]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:45 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934 Sep 17 17:15:45 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:45 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934" returned: 0 in 0.467s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:45 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934 Sep 17 17:15:45 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:46 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0c87ce85-8251-4c7d-b51b-3504a5b0f934" returned: 0 in 0.279s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-0c87ce85-8251-4c7d-b51b-3504a5b0f934" released by "delete_volume" :: held 0.815s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Created reservations ['9e74fb34-b61e-4f28-9f64-1fa77b2f4618', '2946c399-3df5-441d-9d8f-6dfe598071b3', '47e46502-2676-45ba-ad6c-6164a84b221c', '0084a551-0307-4a92-9a64-ebc34147bad6'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:46 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:15:46 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:46 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.275s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:15:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Deleted volume successfully. Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-17d6d551-3dc2-4aa0-a310-c4ccc99c0d71 tempest-VolumesGetTest-482053923 None] Lock "cinder-0c87ce85-8251-4c7d-b51b-3504a5b0f934-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:15:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (aa17da40-e4ca-4acf-b21b-1b8904d10a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db465eb1-4b3b-4c3d-b08a-bdf246eb86d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db465eb1-4b3b-4c3d-b08a-bdf246eb86d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-205913967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64a9ca5-e23a-499e-ac77-a7db488e0338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:47Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fd7281-dd1f-4833-a2a6-3ffceaa91f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fd7281-dd1f-4833-a2a6-3ffceaa91f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a453867-46cc-4b4e-b212-44cd55ebc147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a453867-46cc-4b4e-b212-44cd55ebc147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a64a9ca5-e23a-499e-ac77-a7db488e0338', 'volume_name': 'volume-a64a9ca5-e23a-499e-ac77-a7db488e0338', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1164d290-7d25-4d0c-8754-f0cc60d896a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1164d290-7d25-4d0c-8754-f0cc60d896a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307eed2c-497d-4015-892b-2fa3ee8bb2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:47 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Volume a64a9ca5-e23a-499e-ac77-a7db488e0338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a64a9ca5-e23a-499e-ac77-a7db488e0338', 'volume_size': 1} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-205913967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64a9ca5-e23a-499e-ac77-a7db488e0338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:47Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Creating volume a64a9ca5-e23a-499e-ac77-a7db488e0338 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:15:47 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:47 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 1073741824 Sep 17 17:15:47 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:47 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 1073741824" returned: 0 in 0.424s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:47 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 Sep 17 17:15:47 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:47 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338" returned: 0 in 0.242s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307eed2c-497d-4015-892b-2fa3ee8bb2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64a9ca5-e23a-499e-ac77-a7db488e0338', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3420c32-088f-4641-beb1-e0d278bd6e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:47 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Volume volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 (a64a9ca5-e23a-499e-ac77-a7db488e0338): created successfully Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3420c32-088f-4641-beb1-e0d278bd6e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (aa17da40-e4ca-4acf-b21b-1b8904d10a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:47 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d9a6475f-c5c4-490c-9de7-2aee530214a9 tempest-VolumesGetTest-482053923 None] Created volume successfully. Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (2d03510a-3c48-4c20-b651-62cc391549cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942c1d57-a0df-4dcd-8e3e-38806855caf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942c1d57-a0df-4dcd-8e3e-38806855caf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-878936711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cf1516-7fa9-45ba-80f8-3abf90e5ab9f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a64a9ca5-e23a-499e-ac77-a7db488e0338,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:48Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eaa5ffd-19e2-4e0e-b2df-88c0887cbc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eaa5ffd-19e2-4e0e-b2df-88c0887cbc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed756f4a-8434-4837-b1a0-db9cc092788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed756f4a-8434-4837-b1a0-db9cc092788a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '67cf1516-7fa9-45ba-80f8-3abf90e5ab9f', 'volume_name': 'volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f', 'volume_size': 1, 'source_volid': 'a64a9ca5-e23a-499e-ac77-a7db488e0338', 'source_volstatus': 'available'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76a3e31-4384-4c2e-b888-a47f9443e51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76a3e31-4384-4c2e-b888-a47f9443e51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741827f1-1b28-4c78-8c0f-def66c43fbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:48 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Volume 67cf1516-7fa9-45ba-80f8-3abf90e5ab9f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f', 'volume_size': 1, 'source_volid': 'a64a9ca5-e23a-499e-ac77-a7db488e0338', 'source_volstatus': 'available'} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:48 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Cloning volume a64a9ca5-e23a-499e-ac77-a7db488e0338 to volume 67cf1516-7fa9-45ba-80f8-3abf90e5ab9f Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Creating offline snapshot 17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 of volume a64a9ca5-e23a-499e-ac77-a7db488e0338 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb5c8e0-7af8-43a8-b365-24952abb4962]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:15:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:48 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 Sep 17 17:15:48 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:49 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338" returned: 0 in 0.369s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:49 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 1G Sep 17 17:15:49 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:49 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 1G" returned: 0 in 0.524s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:49 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 Sep 17 17:15:49 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:49 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0" returned: 0 in 0.338s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:49 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 is being set with open permissions: ugo+rw Sep 17 17:15:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:49 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 Sep 17 17:15:49 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:50 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0" returned: 0 in 0.273s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:50 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.info Sep 17 17:15:50 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:50 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.info" returned: 0 in 0.293s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:50 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.info is being set with open permissions: ugo+rw Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:50 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.info Sep 17 17:15:50 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:50 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.info" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-quobyte-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] snapshot: 17ecc72d-f56f-4c77-abc4-d61a60ad4aa0, volume: 67cf1516-7fa9-45ba-80f8-3abf90e5ab9f, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dc1f21-f5f1-4296-aeb1-b98f3cfe7930]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:15:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:50 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 Sep 17 17:15:50 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:51 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0" returned: 0 in 0.417s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a64a9ca5-e23a-499e-ac77-a7db488e0338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:15:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae995cd9-bb87-4673-892d-1586f7a904ae]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:15:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:51 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 Sep 17 17:15:51 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:51 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338" returned: 0 in 0.390s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:15:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:15:51 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:15:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:51 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f Sep 17 17:15:51 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Flow 'volume_create_manager' (02229991-06e3-421f-84bd-3f5ac02c0e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73003d46-866b-4fb4-91d9-181dd36c05fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73003d46-866b-4fb4-91d9-181dd36c05fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-861108742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fae51f3-6bd9-47de-86da-561c1643daff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='773b7d437c3749cabac76c20282ee0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:59Z,use_quota=True,user_id='39497805387e454caafc44803aeb1f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6109c7fc-3602-4bc0-8c90-b07ab852e35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6109c7fc-3602-4bc0-8c90-b07ab852e35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46428802-69db-4a01-a653-5ab56b71de80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46428802-69db-4a01-a653-5ab56b71de80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fae51f3-6bd9-47de-86da-561c1643daff', 'volume_name': 'volume-9fae51f3-6bd9-47de-86da-561c1643daff', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fc9a42-0a78-44bb-9514-3378b8e83b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fc9a42-0a78-44bb-9514-3378b8e83b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e7c6bd-c015-46cb-bce8-6111030c22ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:15:59 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Volume 9fae51f3-6bd9-47de-86da-561c1643daff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fae51f3-6bd9-47de-86da-561c1643daff', 'volume_size': 1} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:15:59 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f" returned: 0 in 8.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338, size 1024.00 MB, duration 8.27 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:15:59 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Converted 1024.00 MB image at 123.88 MB/s Sep 17 17:15:59 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f is being set with open permissions: ugo+rw Sep 17 17:15:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:15:59 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f Sep 17 17:15:59 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:00 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f" returned: 0 in 0.266s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f" released by "_copy_volume_from_snapshot" :: held 9.422s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-quobyte-17ecc72d-f56f-4c77-abc4-d61a60ad4aa0" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-17ecc72d-f56f-4c77-abc4-d61a60ad4aa0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Deleting offline snapshot 17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 of volume a64a9ca5-e23a-499e-ac77-a7db488e0338 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] snapshot_file for this snap is: volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f094409c-4fff-4042-a0e0-8d90e89021b0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:00 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 Sep 17 17:16:00 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:00 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0" returned: 0 in 0.374s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a64a9ca5-e23a-499e-ac77-a7db488e0338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e46be9-91c3-4f14-b659-d72c676318e6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:00 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 Sep 17 17:16:00 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:01 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338" returned: 0 in 0.594s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:01 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 Sep 17 17:16:01 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:01 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0" returned: 0 in 0.378s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:01 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0 Sep 17 17:16:01 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:01 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338.17ecc72d-f56f-4c77-abc4-d61a60ad4aa0" returned: 0 in 0.275s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-17ecc72d-f56f-4c77-abc4-d61a60ad4aa0" released by "_delete_snapshot" :: held 1.740s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.415s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.402s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-861108742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fae51f3-6bd9-47de-86da-561c1643daff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='773b7d437c3749cabac76c20282ee0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:15:59Z,use_quota=True,user_id='39497805387e454caafc44803aeb1f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Creating volume 9fae51f3-6bd9-47de-86da-561c1643daff {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:16:02 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:02 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff 1073741824 Sep 17 17:16:02 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741827f1-1b28-4c78-8c0f-def66c43fbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f', 'volume_size': 1, 'source_volid': 'a64a9ca5-e23a-499e-ac77-a7db488e0338', 'source_volstatus': 'available'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8176edd-bbb0-4520-b40e-b94ca19025e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:02 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Volume volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f (67cf1516-7fa9-45ba-80f8-3abf90e5ab9f): created successfully Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8176edd-bbb0-4520-b40e-b94ca19025e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (2d03510a-3c48-4c20-b651-62cc391549cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5771c287-baa4-496c-9cbf-428c8c17f76e tempest-VolumesGetTest-482053923 None] Created volume successfully. Sep 17 17:16:02 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff 1073741824" returned: 0 in 0.489s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:02 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff Sep 17 17:16:02 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:02 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff" returned: 0 in 0.267s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e7c6bd-c015-46cb-bce8-6111030c22ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fae51f3-6bd9-47de-86da-561c1643daff', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d751d1-94dc-4c4b-b2d5-969a1d26fb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:02 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Volume volume-9fae51f3-6bd9-47de-86da-561c1643daff (9fae51f3-6bd9-47de-86da-561c1643daff): created successfully Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d751d1-94dc-4c4b-b2d5-969a1d26fb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Flow 'volume_create_manager' (02229991-06e3-421f-84bd-3f5ac02c0e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-91247989-1558-44a4-9348-2f011aaa83d0 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Created volume successfully. Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (14fb1c64-f095-4079-a00e-d49f386140ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8a9d24-8470-40a3-9d36-082f1de97e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8a9d24-8470-40a3-9d36-082f1de97e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1688003759',display_name='tempest-VolumesGetTest-Volume-1027944907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d2076f-277c-470f-a3f8-0a2a688ca2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:04Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903d791c-8284-4ffa-830e-11571f9a8f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903d791c-8284-4ffa-830e-11571f9a8f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d670f4-7d27-462f-92f5-5e8b05ef0cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d670f4-7d27-462f-92f5-5e8b05ef0cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d2076f-277c-470f-a3f8-0a2a688ca2ec', 'volume_name': 'volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ba20ea-64b9-4ed6-97f8-8ebda37fbf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ba20ea-64b9-4ed6-97f8-8ebda37fbf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088a7b01-8ce8-4433-b045-2aba82e97c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:03 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Volume 39d2076f-277c-470f-a3f8-0a2a688ca2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec', 'volume_size': 1} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1688003759',display_name='tempest-VolumesGetTest-Volume-1027944907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d2076f-277c-470f-a3f8-0a2a688ca2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:04Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Creating volume 39d2076f-277c-470f-a3f8-0a2a688ca2ec {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:16:03 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:16:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:03 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec 1073741824 Sep 17 17:16:03 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:04 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec 1073741824" returned: 0 in 0.549s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-2b6d94c6-caad-4969-b57e-265510571c64 req-fe8f872e-6404-4414-8232-885ddc0b141e tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:04 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec Sep 17 17:16:04 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:04 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec" returned: 0 in 0.281s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-2b6d94c6-caad-4969-b57e-265510571c64 req-fe8f872e-6404-4414-8232-885ddc0b141e tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.291s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-2b6d94c6-caad-4969-b57e-265510571c64 req-fe8f872e-6404-4414-8232-885ddc0b141e tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088a7b01-8ce8-4433-b045-2aba82e97c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdba1cd5-223b-4dc9-80d0-1e0f282e0f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:04 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Volume volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec (39d2076f-277c-470f-a3f8-0a2a688ca2ec): created successfully Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdba1cd5-223b-4dc9-80d0-1e0f282e0f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (14fb1c64-f095-4079-a00e-d49f386140ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3126f2f4-0939-463c-9c0f-b0bd7254fb7c tempest-VolumesGetTest-482053923 None] Created volume successfully. Sep 17 17:16:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-2b6d94c6-caad-4969-b57e-265510571c64 req-fe8f872e-6404-4414-8232-885ddc0b141e tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-9fae51f3-6bd9-47de-86da-561c1643daff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f0b4c64-44cb-4c4b-b29a-1008a66eb0fa', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:16:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-2b6d94c6-caad-4969-b57e-265510571c64 req-fe8f872e-6404-4414-8232-885ddc0b141e tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] attachment_update completed successfully. Sep 17 17:16:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-39d2076f-277c-470f-a3f8-0a2a688ca2ec-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Lock "cinder-39d2076f-277c-470f-a3f8-0a2a688ca2ec-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-quobyte-39d2076f-277c-470f-a3f8-0a2a688ca2ec" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-39d2076f-277c-470f-a3f8-0a2a688ca2ec" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff336993-0a80-4f6c-880d-251b655f09c3]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:06 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec Sep 17 17:16:06 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:06 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec" returned: 0 in 0.423s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:06 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec Sep 17 17:16:06 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:06 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-39d2076f-277c-470f-a3f8-0a2a688ca2ec" returned: 0 in 0.291s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-39d2076f-277c-470f-a3f8-0a2a688ca2ec" released by "delete_volume" :: held 0.767s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=81,cinder:UPDATE=85,cinder:INSERT=21,cinder:DELETE=9 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=88,cinder:SELECT=76,cinder:INSERT=17,cinder:DELETE=6 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Created reservations ['3f4895b9-e85a-49ee-8f38-5a1d32f39a59', '787fa118-6c12-4f42-9469-ac8657bcba5f', '20a0c702-5ddb-45e3-8d3e-eeaacfbb4f93', '94697d55-671a-42f0-a981-8cf8fcc74d94'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:06 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:16:06 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Lock "cinder-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-quobyte-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:07 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.357s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa84aef-4243-4dd5-81e1-07e51acc37cf]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Deleted volume successfully. Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cbbf61c6-c748-4807-bdb4-6c4c348a7e7c tempest-VolumesGetTest-482053923 None] Lock "cinder-39d2076f-277c-470f-a3f8-0a2a688ca2ec-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:07 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f Sep 17 17:16:07 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:07 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f" returned: 0 in 0.442s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:07 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f Sep 17 17:16:07 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:08 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f" returned: 0 in 0.326s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f" released by "delete_volume" :: held 0.851s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Created reservations ['ad868f0b-4531-450e-80ed-52b405bb1812', 'dc8b5757-09d7-4573-89bb-a3855e4b06a5', '80dc83ea-b37d-4e13-a9bf-92372687bdc4', '4542a530-d895-4738-a556-7ee3809df652'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:08 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:16:08 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:08 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-e503a233-30b1-43c8-9a35-3968e2fc5b14 req-eb1b41dc-b1ee-42fe-b966-62bca4cd56eb tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Terminate volume connection completed successfully. Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-e503a233-30b1-43c8-9a35-3968e2fc5b14 req-eb1b41dc-b1ee-42fe-b966-62bca4cd56eb tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Deleting attachment 2f0b4c64-44cb-4c4b-b29a-1008a66eb0fa. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-a64a9ca5-e23a-499e-ac77-a7db488e0338-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Lock "cinder-a64a9ca5-e23a-499e-ac77-a7db488e0338-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-quobyte-a64a9ca5-e23a-499e-ac77-a7db488e0338" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-a64a9ca5-e23a-499e-ac77-a7db488e0338" acquired by "delete_volume" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:08 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.419s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:16:08 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Deleted volume successfully. Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f62ec5-4fcb-40b6-adea-6161bcb65651]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4e6d265-60f7-481c-830a-700e4598834e tempest-VolumesGetTest-482053923 None] Lock "cinder-67cf1516-7fa9-45ba-80f8-3abf90e5ab9f-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:08 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 Sep 17 17:16:08 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:09 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338" returned: 0 in 0.453s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:09 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338 Sep 17 17:16:09 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Acquiring lock "cinder-9fae51f3-6bd9-47de-86da-561c1643daff-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "cinder-9fae51f3-6bd9-47de-86da-561c1643daff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Acquiring lock "cinder-quobyte-9fae51f3-6bd9-47de-86da-561c1643daff" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "cinder-quobyte-9fae51f3-6bd9-47de-86da-561c1643daff" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a0a1be-3c32-48cc-9002-6dfe5d1b3144]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:09 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a64a9ca5-e23a-499e-ac77-a7db488e0338" returned: 0 in 0.307s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-a64a9ca5-e23a-499e-ac77-a7db488e0338" released by "delete_volume" :: held 0.853s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Created reservations ['728b2675-1ad1-4a42-a109-dfa0d110c3c7', 'efb0924b-1557-40a5-a574-914f0dcef2c3', 'f422464b-b6de-4741-b8cf-0abe037a6205', 'f267c6be-f95e-4453-8d5f-1c8b414ef7cd'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:16:09 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff Sep 17 17:16:09 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:09 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:16:09 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:09 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff" returned: 0 in 0.472s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:09 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff Sep 17 17:16:09 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:10 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.391s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:16:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Deleted volume successfully. Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2a31ddfe-5ab9-4040-bc11-f6de33a0441c tempest-VolumesGetTest-482053923 None] Lock "cinder-a64a9ca5-e23a-499e-ac77-a7db488e0338-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:10 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9fae51f3-6bd9-47de-86da-561c1643daff" returned: 0 in 0.321s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "cinder-quobyte-9fae51f3-6bd9-47de-86da-561c1643daff" released by "delete_volume" :: held 0.856s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Created reservations ['3a8d9952-4b20-4041-995d-6b484586eac0', '6aec4066-19de-405c-a369-ec6f2a97d844', '1c1c4ac0-8c39-4f1f-a6b2-9211facd1f19', '18975941-7fd3-42a0-b0fa-f54cb0cc6167'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:10 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:16:10 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (f933ef47-f533-4fb4-9170-000ec3edd2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cfc792-6952-4c59-9e65-bf6e03ae3ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cfc792-6952-4c59-9e65-bf6e03ae3ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1235250652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b065b2d0-dfd5-4db2-9e12-22369201acde,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:11Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c82ae2c-8de0-4dc2-84c9-45392188d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:10 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c82ae2c-8de0-4dc2-84c9-45392188d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61784e4-f118-4859-9881-2b5ea19824b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.image.glance [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Creating Keystone auth plugin from conf {{(pid=85889) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.530s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:10 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:16:11 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Deleted volume successfully. Sep 17 17:16:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a6c5c830-5966-4978-922f-f3859a0c07b2 tempest-TestServerVolumeAttachScenarioOldVersion-762119963 None] Lock "cinder-9fae51f3-6bd9-47de-86da-561c1643daff-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61784e4-f118-4859-9881-2b5ea19824b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b065b2d0-dfd5-4db2-9e12-22369201acde', 'volume_name': 'volume-b065b2d0-dfd5-4db2-9e12-22369201acde', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f266e5e-35bb-437f-ac07-5ee1321bbf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f266e5e-35bb-437f-ac07-5ee1321bbf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bdba5f-6271-4641-ac81-0de5ec9e270a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:11 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Volume b065b2d0-dfd5-4db2-9e12-22369201acde: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b065b2d0-dfd5-4db2-9e12-22369201acde', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 17:16:11 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Trying to clone b065b2d0-dfd5-4db2-9e12-22369201acde from image 7afddb82-049d-4cb0-9488-82066e4ce33b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]). {{(pid=85889) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 17:16:12 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Image download 20.69 MB at 20.69 MB/s Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2c727d-c48c-4397-9bbb-a1ae2c1c5dc2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:12 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD Sep 17 17:16:12 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:12 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Temporary image 7afddb82-049d-4cb0-9488-82066e4ce33b is fetched for user 83dc62ec1fb14029817ff4408933ad68. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b73fdf-6fff-4459-b871-1433dd0ec642]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:12 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD Sep 17 17:16:12 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:12 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1235250652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b065b2d0-dfd5-4db2-9e12-22369201acde,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:11Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Creating volume b065b2d0-dfd5-4db2-9e12-22369201acde {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:16:12 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:16:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:13 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde 1073741824 Sep 17 17:16:13 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:13 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde 1073741824" returned: 0 in 0.728s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:13 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde Sep 17 17:16:13 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:14 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde" returned: 0 in 0.334s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:16:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:14 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Attempting download of 7afddb82-049d-4cb0-9488-82066e4ce33b ((None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}])) to volume b065b2d0-dfd5-4db2-9e12-22369201acde. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 17:16:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4391bfc-244c-4727-b106-98435fdc358d]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_hauzgdey {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:14 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_hauzgdey Sep 17 17:16:14 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:14 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_hauzgdey" returned: 0 in 0.375s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_hauzgdey {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:14 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_hauzgdey Sep 17 17:16:14 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:14 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_hauzgdey" returned: 1 in 0.396s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_hauzgdey' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:16:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ee43d4-607c-4164-aa7e-1613253d399c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:15 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD Sep 17 17:16:15 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:15 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:15 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] 7afddb82-049d-4cb0-9488-82066e4ce33b was qcow2, converting to qcow2 {{(pid=85889) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 17:16:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:15 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde Sep 17 17:16:15 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:17 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde" returned: 0 in 2.367s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:17 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b_4u6e962edevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:16:17 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Converted 112.00 MB image at 47.30 MB/s Sep 17 17:16:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:17 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde 1G Sep 17 17:16:17 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:18 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde 1G" returned: 0 in 0.400s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:18 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Downloaded image 7afddb82-049d-4cb0-9488-82066e4ce33b ((None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}])) to volume b065b2d0-dfd5-4db2-9e12-22369201acde successfully. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 17:16:18 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Temporary image 7afddb82-049d-4cb0-9488-82066e4ce33b for user 83dc62ec1fb14029817ff4408933ad68 is deleted. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 17:16:18 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Marking volume b065b2d0-dfd5-4db2-9e12-22369201acde as bootable. {{(pid=85889) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 17:16:18 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Copying metadata from image 7afddb82-049d-4cb0-9488-82066e4ce33b to b065b2d0-dfd5-4db2-9e12-22369201acde. {{(pid=85889) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 17:16:18 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Creating volume glance metadata for volume b065b2d0-dfd5-4db2-9e12-22369201acde backed by image 7afddb82-049d-4cb0-9488-82066e4ce33b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85889) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 17:16:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bdba5f-6271-4641-ac81-0de5ec9e270a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b065b2d0-dfd5-4db2-9e12-22369201acde', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02611e92-0f4e-4c4f-8464-f5dbc921abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:18 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Volume volume-b065b2d0-dfd5-4db2-9e12-22369201acde (b065b2d0-dfd5-4db2-9e12-22369201acde): created successfully Sep 17 17:16:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02611e92-0f4e-4c4f-8464-f5dbc921abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (f933ef47-f533-4fb4-9170-000ec3edd2ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:18 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7dd5baa0-445a-483f-a268-a22858b23c92 tempest-VolumesGetTest-482053923 None] Created volume successfully. Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (6720870b-6fd3-489f-8f2b-919163728efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36bade31-002c-498a-b5c4-8bade7fefa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36bade31-002c-498a-b5c4-8bade7fefa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-361462536',display_name='tempest-VolumesGetTest-Volume-1640697010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ea2065-e57f-4e16-b5fa-fddbb2efa97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:20Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac4a300-c6fc-4512-af58-2f23e01934ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac4a300-c6fc-4512-af58-2f23e01934ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65367d1b-b94b-4356-a309-46bc791fa894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65367d1b-b94b-4356-a309-46bc791fa894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ea2065-e57f-4e16-b5fa-fddbb2efa97e', 'volume_name': 'volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f22e272-27f7-4913-91b4-c6914e310e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f22e272-27f7-4913-91b4-c6914e310e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d948ca-ec59-4784-a88d-00038f327ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:20 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Volume 95ea2065-e57f-4e16-b5fa-fddbb2efa97e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e', 'volume_size': 1} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-361462536',display_name='tempest-VolumesGetTest-Volume-1640697010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ea2065-e57f-4e16-b5fa-fddbb2efa97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4920b1c33794c3aa3053b47538514f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:20Z,use_quota=True,user_id='83dc62ec1fb14029817ff4408933ad68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Creating volume 95ea2065-e57f-4e16-b5fa-fddbb2efa97e {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:16:20 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:20 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e 1073741824 Sep 17 17:16:20 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:20 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e 1073741824" returned: 0 in 0.674s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:21 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e Sep 17 17:16:21 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:21 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e" returned: 0 in 0.323s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:16:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d948ca-ec59-4784-a88d-00038f327ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accc3eaa-2bfa-416a-a2d1-a22a34557b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:21 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Volume volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e (95ea2065-e57f-4e16-b5fa-fddbb2efa97e): created successfully Sep 17 17:16:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accc3eaa-2bfa-416a-a2d1-a22a34557b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:21 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Flow 'volume_create_manager' (6720870b-6fd3-489f-8f2b-919163728efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:21 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f9f6d956-0101-4b86-8328-f628a471550a tempest-VolumesGetTest-482053923 None] Created volume successfully. Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:22 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:16:22 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-95ea2065-e57f-4e16-b5fa-fddbb2efa97e-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Lock "cinder-95ea2065-e57f-4e16-b5fa-fddbb2efa97e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-quobyte-95ea2065-e57f-4e16-b5fa-fddbb2efa97e" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-95ea2065-e57f-4e16-b5fa-fddbb2efa97e" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e96978-01c0-4048-b227-2cc855dc849b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:22 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.388s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:16:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:16:22 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e Sep 17 17:16:22 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:23 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e" returned: 0 in 0.449s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:23 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e Sep 17 17:16:23 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:23 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95ea2065-e57f-4e16-b5fa-fddbb2efa97e" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-95ea2065-e57f-4e16-b5fa-fddbb2efa97e" released by "delete_volume" :: held 0.877s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Created reservations ['e490c191-feb5-4804-96f1-13638618ddd1', 'e13c6cf5-49ff-4a58-a561-0beaef15c27d', '9d7b2d87-2bef-454d-aa35-6064ee817d1a', 'efe79d91-9d59-4b1d-b053-3d11e171ca11'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:23 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:16:23 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-b065b2d0-dfd5-4db2-9e12-22369201acde-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Lock "cinder-b065b2d0-dfd5-4db2-9e12-22369201acde-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Acquiring lock "cinder-quobyte-b065b2d0-dfd5-4db2-9e12-22369201acde" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-b065b2d0-dfd5-4db2-9e12-22369201acde" acquired by "delete_volume" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9778fce-d505-4fda-8c23-a56b9b22661a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:24 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.329s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:16:24 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Deleted volume successfully. Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d0c704c3-14dc-49a3-aaee-c42ff9a66dc9 tempest-VolumesGetTest-482053923 None] Lock "cinder-95ea2065-e57f-4e16-b5fa-fddbb2efa97e-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:24 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde Sep 17 17:16:24 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:24 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde" returned: 0 in 0.414s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:24 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde Sep 17 17:16:24 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:24 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b065b2d0-dfd5-4db2-9e12-22369201acde" returned: 0 in 0.367s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Lock "cinder-quobyte-b065b2d0-dfd5-4db2-9e12-22369201acde" released by "delete_volume" :: held 0.838s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Created reservations ['b61df633-2ad1-4ac8-81fd-538fa68435ba', 'f640e7e6-00c0-4d27-a86d-a1c950938dca', 'd88fb822-795c-4289-957e-e79965f9f9b8', '7110536f-1f7f-41f8-9437-eb875db25723'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:24 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:16:24 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:25 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.282s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:25 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:16:25 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Deleted volume successfully. Sep 17 17:16:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-47d1aba8-c3eb-491e-b75c-191b67b39726 tempest-VolumesGetTest-482053923 None] Lock "cinder-b065b2d0-dfd5-4db2-9e12-22369201acde-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Flow 'volume_create_manager' (7f1c1a5c-96ce-441e-a4b2-74ac5b3ddc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db38879-1bb2-4b17-b3db-a1b8294ffdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db38879-1bb2-4b17-b3db-a1b8294ffdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-729207261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e71f25-80ad-4691-b8d3-a04f232ed095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368e7a7a274e48bd8e5f5c8d0832f660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:29Z,use_quota=True,user_id='7271c94bf18e43c0adccffda9591fc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a555ff36-e6ed-4083-8284-a719da10cfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a555ff36-e6ed-4083-8284-a719da10cfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5ccbad-3600-48bc-8020-9823b81ce8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5ccbad-3600-48bc-8020-9823b81ce8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e71f25-80ad-4691-b8d3-a04f232ed095', 'volume_name': 'volume-92e71f25-80ad-4691-b8d3-a04f232ed095', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa1c31c-483f-4a22-9a1e-149062a1af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa1c31c-483f-4a22-9a1e-149062a1af45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b28d42-2e39-44d0-a5d7-69736af286ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:28 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Volume 92e71f25-80ad-4691-b8d3-a04f232ed095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e71f25-80ad-4691-b8d3-a04f232ed095', 'volume_size': 1} Sep 17 17:16:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-729207261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e71f25-80ad-4691-b8d3-a04f232ed095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368e7a7a274e48bd8e5f5c8d0832f660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:29Z,use_quota=True,user_id='7271c94bf18e43c0adccffda9591fc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Creating volume 92e71f25-80ad-4691-b8d3-a04f232ed095 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:16:29 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:29 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095 1073741824 Sep 17 17:16:29 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Flow 'volume_create_manager' (5b3c5185-f38b-4331-a312-d21a04d183d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea070af0-cc6a-4a39-bc08-0b78b9c5f908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea070af0-cc6a-4a39-bc08-0b78b9c5f908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1762444739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462027de-6d56-4fa8-9777-6416b89a8a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368e7a7a274e48bd8e5f5c8d0832f660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:29Z,use_quota=True,user_id='7271c94bf18e43c0adccffda9591fc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411d0a36-05b1-415c-9a25-361075c10ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411d0a36-05b1-415c-9a25-361075c10ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4dd054f-35f5-4a47-95a6-bfd2dfed7c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4dd054f-35f5-4a47-95a6-bfd2dfed7c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462027de-6d56-4fa8-9777-6416b89a8a71', 'volume_name': 'volume-462027de-6d56-4fa8-9777-6416b89a8a71', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1339750-86b6-4761-a7c1-0a9791032f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1339750-86b6-4761-a7c1-0a9791032f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b2917d-e36b-4ab2-8e62-553d9fcdf7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:29 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Volume 462027de-6d56-4fa8-9777-6416b89a8a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462027de-6d56-4fa8-9777-6416b89a8a71', 'volume_size': 1} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:29 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095 1073741824" returned: 0 in 0.662s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:29 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095 Sep 17 17:16:29 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:30 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095" returned: 0 in 0.355s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1762444739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462027de-6d56-4fa8-9777-6416b89a8a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368e7a7a274e48bd8e5f5c8d0832f660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:29Z,use_quota=True,user_id='7271c94bf18e43c0adccffda9591fc81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Creating volume 462027de-6d56-4fa8-9777-6416b89a8a71 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:16:30 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b28d42-2e39-44d0-a5d7-69736af286ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e71f25-80ad-4691-b8d3-a04f232ed095', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587b09d0-511c-423a-917f-e2e1e3804118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Volume volume-92e71f25-80ad-4691-b8d3-a04f232ed095 (92e71f25-80ad-4691-b8d3-a04f232ed095): created successfully Sep 17 17:16:30 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71 1073741824 Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587b09d0-511c-423a-917f-e2e1e3804118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:30 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Flow 'volume_create_manager' (7f1c1a5c-96ce-441e-a4b2-74ac5b3ddc7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-98b3a8db-502e-4838-ae6e-d7e0d09339d4 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Created volume successfully. Sep 17 17:16:30 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71 1073741824" returned: 0 in 0.540s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:30 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71 Sep 17 17:16:30 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:30 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71" returned: 0 in 0.294s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:16:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b2917d-e36b-4ab2-8e62-553d9fcdf7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462027de-6d56-4fa8-9777-6416b89a8a71', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13493cd-6dca-4fde-8349-b7566496a7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:31 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Volume volume-462027de-6d56-4fa8-9777-6416b89a8a71 (462027de-6d56-4fa8-9777-6416b89a8a71): created successfully Sep 17 17:16:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13493cd-6dca-4fde-8349-b7566496a7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Flow 'volume_create_manager' (5b3c5185-f38b-4331-a312-d21a04d183d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9662ecd8-8dd9-430e-b84f-36a427677e14 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Created volume successfully. Sep 17 17:16:41 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:INSERT=18,cinder:UPDATE=59,cinder:SELECT=39,cinder:DELETE=4 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:16:41 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=50,cinder:INSERT=23,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Flow 'volume_create_manager' (78ea1edc-7c1e-4a0c-bdbf-cc8dadc0c69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bf7509-4661-400c-8bdf-a1bae8a376f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bf7509-4661-400c-8bdf-a1bae8a376f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-571379602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9622b85d-dd60-41ef-9fdf-e41c2f81505e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8680f9274e54b7ba9090deb045b6c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:48Z,use_quota=True,user_id='cc9717b24b3e43db9f3b369bfebfbbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0387b5b1-e204-4bcd-b7af-123559e4d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0387b5b1-e204-4bcd-b7af-123559e4d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4508ff95-831c-4a24-82f0-ddffd6ddd2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4508ff95-831c-4a24-82f0-ddffd6ddd2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9622b85d-dd60-41ef-9fdf-e41c2f81505e', 'volume_name': 'volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5b13b4-4d2f-4fcf-84af-66b8deb47cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5b13b4-4d2f-4fcf-84af-66b8deb47cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55c7ad8-ba83-488d-afbb-b0b8170041e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:48 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Volume 9622b85d-dd60-41ef-9fdf-e41c2f81505e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e', 'volume_size': 1} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-571379602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9622b85d-dd60-41ef-9fdf-e41c2f81505e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8680f9274e54b7ba9090deb045b6c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:48Z,use_quota=True,user_id='cc9717b24b3e43db9f3b369bfebfbbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Creating volume 9622b85d-dd60-41ef-9fdf-e41c2f81505e {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:16:48 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:16:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:48 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e 1073741824 Sep 17 17:16:48 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:49 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e 1073741824" returned: 0 in 0.600s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:49 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e Sep 17 17:16:49 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:49 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e" returned: 0 in 0.340s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:16:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55c7ad8-ba83-488d-afbb-b0b8170041e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf54510-173f-411b-82cc-7c02b19657c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:49 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Volume volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e (9622b85d-dd60-41ef-9fdf-e41c2f81505e): created successfully Sep 17 17:16:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf54510-173f-411b-82cc-7c02b19657c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Flow 'volume_create_manager' (78ea1edc-7c1e-4a0c-bdbf-cc8dadc0c69f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:49 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7dcb71c1-cab8-4066-bf14-b9c776ac21d8 tempest-VolumesSnapshotTestJSON-1666238325 None] Created volume successfully. Sep 17 17:16:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Creating offline snapshot 303358e4-72e6-402d-9cfb-1ff38f791449 of volume 9622b85d-dd60-41ef-9fdf-e41c2f81505e {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:16:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c8269d-d082-4fcf-9902-987f1950958b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:51 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e Sep 17 17:16:51 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:51 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e" returned: 0 in 0.495s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:51 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 1G Sep 17 17:16:51 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:52 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 1G" returned: 0 in 0.794s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:52 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 Sep 17 17:16:52 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:52 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449" returned: 0 in 0.348s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:52 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 is being set with open permissions: ugo+rw Sep 17 17:16:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:52 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 Sep 17 17:16:52 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:52 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449" returned: 0 in 0.292s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:53 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.info Sep 17 17:16:53 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:53 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.info" returned: 0 in 0.411s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:53 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.info is being set with open permissions: ugo+rw Sep 17 17:16:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:53 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.info Sep 17 17:16:53 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:53 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.info" returned: 0 in 0.418s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:53 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-adc096b6-bf66-47c8-8e4f-6f03a0d949e5 tempest-VolumesSnapshotTestJSON-1666238325 None] Create snapshot completed successfully Sep 17 17:16:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-303358e4-72e6-402d-9cfb-1ff38f791449-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-303358e4-72e6-402d-9cfb-1ff38f791449-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-9622b85d-dd60-41ef-9fdf-e41c2f81505e" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-9622b85d-dd60-41ef-9fdf-e41c2f81505e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-303358e4-72e6-402d-9cfb-1ff38f791449" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:16:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-303358e4-72e6-402d-9cfb-1ff38f791449" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:16:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Deleting offline snapshot 303358e4-72e6-402d-9cfb-1ff38f791449 of volume 9622b85d-dd60-41ef-9fdf-e41c2f81505e {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:16:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] snapshot_file for this snap is: volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:16:54 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d72bb4-6fab-4e65-9529-49871702970d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:54 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 Sep 17 17:16:54 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:55 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449" returned: 0 in 0.515s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:16:55 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bc6975-38a2-4dd3-8f95-ba27673b08c0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:16:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:55 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e Sep 17 17:16:55 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:55 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e" returned: 0 in 0.563s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:55 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 Sep 17 17:16:55 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:56 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449" returned: 0 in 0.401s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:56 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449 Sep 17 17:16:56 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:56 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e.303358e4-72e6-402d-9cfb-1ff38f791449" returned: 0 in 0.311s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-303358e4-72e6-402d-9cfb-1ff38f791449" released by "_delete_snapshot" :: held 1.950s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-9622b85d-dd60-41ef-9fdf-e41c2f81505e" released by "delete_snapshot" :: held 1.995s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:56 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Created reservations ['b2cb4630-bc84-4b71-bcfa-984fc6a6ad8c', 'b3351291-0fe1-4e89-ba6b-b28f0241c00c', 'c48243ce-a84b-4bf7-808b-30be10aa2599', '3ff30b6c-7942-4593-8f52-6e4b8b55d4ba'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:16:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Delete snapshot completed successfully. Sep 17 17:16:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-606fad36-dc50-4ed3-ba03-a7660e5e7d90 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-303358e4-72e6-402d-9cfb-1ff38f791449-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Flow 'volume_create_manager' (2b804de7-2a5e-413b-8844-979986abaeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca983b25-9a98-4ced-8622-623092a28700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca983b25-9a98-4ced-8622-623092a28700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1847973962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0b1e71-791c-48f9-b6f3-d85bce41eae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8680f9274e54b7ba9090deb045b6c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:58Z,use_quota=True,user_id='cc9717b24b3e43db9f3b369bfebfbbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f639ffe-e804-4af6-a8e5-f9e6231939b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f639ffe-e804-4af6-a8e5-f9e6231939b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40eed15b-6d35-484d-9efe-a0143395cd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40eed15b-6d35-484d-9efe-a0143395cd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c0b1e71-791c-48f9-b6f3-d85bce41eae2', 'volume_name': 'volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd24bd14-d272-460c-bab1-5ef0105a568e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd24bd14-d272-460c-bab1-5ef0105a568e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d299f07-38b9-4c6e-81d9-5ec80abe911b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:58 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Volume 4c0b1e71-791c-48f9-b6f3-d85bce41eae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2', 'volume_size': 1} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1847973962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0b1e71-791c-48f9-b6f3-d85bce41eae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8680f9274e54b7ba9090deb045b6c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:16:58Z,use_quota=True,user_id='cc9717b24b3e43db9f3b369bfebfbbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Creating volume 4c0b1e71-791c-48f9-b6f3-d85bce41eae2 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:16:58 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:58 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 1073741824 Sep 17 17:16:58 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:58 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 1073741824" returned: 0 in 0.493s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:16:58 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 Sep 17 17:16:58 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:16:59 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 17 17:16:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" returned: 0 in 0.284s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:16:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:16:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:16:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d299f07-38b9-4c6e-81d9-5ec80abe911b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efe2a16-ba00-4274-b8bf-844270ba0672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:16:59 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Volume volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 (4c0b1e71-791c-48f9-b6f3-d85bce41eae2): created successfully Sep 17 17:16:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efe2a16-ba00-4274-b8bf-844270ba0672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:16:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Flow 'volume_create_manager' (2b804de7-2a5e-413b-8844-979986abaeb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:16:59 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ce42ce31-5a53-426a-9cbf-fb1747d9b0a5 tempest-VolumesSnapshotTestJSON-1666238325 None] Created volume successfully. Sep 17 17:17:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Creating offline snapshot f003d06e-a1d0-445a-8de9-9a2da417a37e of volume 4c0b1e71-791c-48f9-b6f3-d85bce41eae2 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:17:00 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[327b678a-3e29-4814-a9fd-02a62297c14a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:00 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 Sep 17 17:17:00 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:01 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" returned: 0 in 0.389s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:01 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e 1G Sep 17 17:17:01 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Flow 'volume_create_manager' (b7ec4400-390a-41a2-b23d-8578760af44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402a9e90-f552-4187-b5f3-83e190cc14f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402a9e90-f552-4187-b5f3-83e190cc14f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1314882010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e342c35-b7e8-4965-b888-75b781cbbcf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e5f050dd14bf39c796ae631168e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:17:01Z,use_quota=True,user_id='e5bed9c8efbf4bed80e27311f3ad44e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc77d75-4b55-4e95-95f4-1b945e9c601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc77d75-4b55-4e95-95f4-1b945e9c601d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ee16bb-4218-4df6-81a7-bd6fab697f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.image.glance [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Creating Keystone auth plugin from conf {{(pid=85889) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 17:17:01 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e 1G" returned: 0 in 0.488s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:01 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e Sep 17 17:17:01 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ee16bb-4218-4df6-81a7-bd6fab697f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e342c35-b7e8-4965-b888-75b781cbbcf9', 'volume_name': 'volume-0e342c35-b7e8-4965-b888-75b781cbbcf9', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a64feae-4284-4e26-ae57-48cd1d06849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a64feae-4284-4e26-ae57-48cd1d06849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaee4c8f-81aa-4587-85d1-691bc69ea915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:01 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Volume 0e342c35-b7e8-4965-b888-75b781cbbcf9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e342c35-b7e8-4965-b888-75b781cbbcf9', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 17:17:01 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Trying to clone 0e342c35-b7e8-4965-b888-75b781cbbcf9 from image 7afddb82-049d-4cb0-9488-82066e4ce33b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]). {{(pid=85889) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 17:17:02 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e" returned: 0 in 0.406s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:02 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e is being set with open permissions: ugo+rw Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:02 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e Sep 17 17:17:02 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 17:17:02 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Image download 20.69 MB at 20.69 MB/s Sep 17 17:17:02 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e" returned: 0 in 0.307s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bef604d-c51a-496a-9aaa-4495864555e7]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:02 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.info Sep 17 17:17:02 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:02 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD Sep 17 17:17:02 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:02 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.info" returned: 0 in 0.295s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:02 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.info is being set with open permissions: ugo+rw Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:02 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Temporary image 7afddb82-049d-4cb0-9488-82066e4ce33b is fetched for user e5bed9c8efbf4bed80e27311f3ad44e8. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 17:17:02 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.info Sep 17 17:17:02 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b1f4fa-f289-4317-959f-774ad13a1340]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:02 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.info" returned: 0 in 0.263s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-2edd0c44-5b28-4aec-b010-066fce51668c tempest-VolumesSnapshotTestJSON-1666238325 None] Create snapshot completed successfully Sep 17 17:17:03 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD Sep 17 17:17:03 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:03 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1314882010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e342c35-b7e8-4965-b888-75b781cbbcf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e5f050dd14bf39c796ae631168e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:17:01Z,use_quota=True,user_id='e5bed9c8efbf4bed80e27311f3ad44e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Creating volume 0e342c35-b7e8-4965-b888-75b781cbbcf9 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:17:03 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:03 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 1073741824 Sep 17 17:17:03 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:03 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 1073741824" returned: 0 in 0.434s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:03 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 Sep 17 17:17:03 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:04 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9" returned: 0 in 0.346s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Attempting download of 7afddb82-049d-4cb0-9488-82066e4ce33b ((None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}])) to volume 0e342c35-b7e8-4965-b888-75b781cbbcf9. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[25274cd9-fd9b-4c17-bbac-c854a66dc3dd]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_y46td2ym {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:04 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_y46td2ym Sep 17 17:17:04 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Flow 'volume_create_manager' (3d0134c3-b0f7-49ed-9f41-ee770acdb1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8851e7-84b6-44de-856c-e493e1af005b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8851e7-84b6-44de-856c-e493e1af005b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-432362474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9129da-ea06-4a0a-9e16-8d2753bb4a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8680f9274e54b7ba9090deb045b6c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:17:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f003d06e-a1d0-445a-8de9-9a2da417a37e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:17:04Z,use_quota=True,user_id='cc9717b24b3e43db9f3b369bfebfbbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03906796-8520-440a-bf8a-bbcb7b03eec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:04 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03906796-8520-440a-bf8a-bbcb7b03eec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a712cf6-af4a-4e5e-9990-352ad46c1918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a712cf6-af4a-4e5e-9990-352ad46c1918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1f9129da-ea06-4a0a-9e16-8d2753bb4a19', 'volume_name': 'volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19', 'volume_size': 2, 'snapshot_id': 'f003d06e-a1d0-445a-8de9-9a2da417a37e'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b78bdf4-b16e-42d4-a694-4830eb480744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b78bdf4-b16e-42d4-a694-4830eb480744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f714a2-af58-4d03-b039-2b98f7d06d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:04 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Volume 1f9129da-ea06-4a0a-9e16-8d2753bb4a19: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19', 'volume_size': 2, 'snapshot_id': 'f003d06e-a1d0-445a-8de9-9a2da417a37e'} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_y46td2ym" returned: 0 in 0.409s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_y46td2ym {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-f003d06e-a1d0-445a-8de9-9a2da417a37e-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" by "_create_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-f003d06e-a1d0-445a-8de9-9a2da417a37e-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Creating volume 1f9129da-ea06-4a0a-9e16-8d2753bb4a19 from snapshot f003d06e-a1d0-445a-8de9-9a2da417a37e {{(pid=85889) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] snapshot: f003d06e-a1d0-445a-8de9-9a2da417a37e, volume: 1f9129da-ea06-4a0a-9e16-8d2753bb4a19, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:04 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_y46td2ym Sep 17 17:17:04 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d3df77-c1e3-4ef6-9dc7-021fa834778f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:04 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e Sep 17 17:17:04 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:04 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_y46td2ym" returned: 1 in 0.339s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7afddb82-049d-4cb0-9488-82066e4ce33b_y46td2ym' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[198acf25-9fb6-486c-9037-7abcb44ef1cc]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:05 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD Sep 17 17:17:05 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:05 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e" returned: 0 in 0.374s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b87d5a2-6271-47f6-a0f0-1ca4d0b12734]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:05 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 Sep 17 17:17:05 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:05 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] 7afddb82-049d-4cb0-9488-82066e4ce33b was qcow2, converting to qcow2 {{(pid=85889) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:05 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 Sep 17 17:17:05 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:05 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" returned: 0 in 0.367s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:17:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:05 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 Sep 17 17:17:05 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:08 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9" returned: 0 in 3.643s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:08 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7afddb82-049d-4cb0-9488-82066e4ce33b__q0sp1tbdevstack@QuobyteHD, size 112.00 MB, duration 3.64 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:17:08 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Converted 112.00 MB image at 30.74 MB/s Sep 17 17:17:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:08 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 1G Sep 17 17:17:08 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:09 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 1G" returned: 0 in 0.596s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:09 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Downloaded image 7afddb82-049d-4cb0-9488-82066e4ce33b ((None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}])) to volume 0e342c35-b7e8-4965-b888-75b781cbbcf9 successfully. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 17:17:09 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Temporary image 7afddb82-049d-4cb0-9488-82066e4ce33b for user e5bed9c8efbf4bed80e27311f3ad44e8 is deleted. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 17:17:09 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Marking volume 0e342c35-b7e8-4965-b888-75b781cbbcf9 as bootable. {{(pid=85889) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 17:17:09 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Copying metadata from image 7afddb82-049d-4cb0-9488-82066e4ce33b to 0e342c35-b7e8-4965-b888-75b781cbbcf9. {{(pid=85889) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 17:17:09 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Creating volume glance metadata for volume 0e342c35-b7e8-4965-b888-75b781cbbcf9 backed by image 7afddb82-049d-4cb0-9488-82066e4ce33b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85889) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 17:17:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaee4c8f-81aa-4587-85d1-691bc69ea915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e342c35-b7e8-4965-b888-75b781cbbcf9', 'volume_size': 1, 'image_id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7afddb82-049d-4cb0-9488-82066e4ce33b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aeac1d0e79849e9a8036e5c6c25891e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7afddb82-049d-4cb0-9488-82066e4ce33b', 'created_at': datetime.datetime(2026, 9, 17, 14, 56, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7afddb82-049d-4cb0-9488-82066e4ce33b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a386ef-ee3b-48c6-bba8-373f945825f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:09 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Volume volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 (0e342c35-b7e8-4965-b888-75b781cbbcf9): created successfully Sep 17 17:17:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a386ef-ee3b-48c6-bba8-373f945825f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Flow 'volume_create_manager' (b7ec4400-390a-41a2-b23d-8578760af44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e348db20-d6cd-4adc-b363-bdefc0ee102c tempest-TestShelveInstance-1453332328 None] Created volume successfully. Sep 17 17:17:12 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" returned: 0 in 7.316s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:12 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2, size 1024.00 MB, duration 7.32 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:17:12 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Converted 1024.00 MB image at 139.95 MB/s Sep 17 17:17:12 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 is being set with open permissions: ugo+rw Sep 17 17:17:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:12 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 Sep 17 17:17:12 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:13 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" returned: 0 in 0.310s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" released by "_copy_volume_from_snapshot" :: held 8.471s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-f003d06e-a1d0-445a-8de9-9a2da417a37e-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" released by "_create_volume_from_snapshot" :: held 8.539s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.557s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f714a2-af58-4d03-b039-2b98f7d06d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19', 'volume_size': 2, 'snapshot_id': 'f003d06e-a1d0-445a-8de9-9a2da417a37e'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2705b6-df57-470b-ba1b-5f3011b7b183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:13 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Volume volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 (1f9129da-ea06-4a0a-9e16-8d2753bb4a19): created successfully Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2705b6-df57-470b-ba1b-5f3011b7b183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Flow 'volume_create_manager' (3d0134c3-b0f7-49ed-9f41-ee770acdb1b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-80c3bb53-3fe2-4d58-a706-19e02d5d8f37 tempest-VolumesSnapshotTestJSON-1666238325 None] Created volume successfully. Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-4b5638bb-7f2a-4730-ac9f-9a5ea946e0c9 req-f01365db-78e7-4a03-96fd-5fa3a2214b3d tempest-TestShelveInstance-1453332328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-4b5638bb-7f2a-4730-ac9f-9a5ea946e0c9 req-f01365db-78e7-4a03-96fd-5fa3a2214b3d tempest-TestShelveInstance-1453332328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-4b5638bb-7f2a-4730-ac9f-9a5ea946e0c9 req-f01365db-78e7-4a03-96fd-5fa3a2214b3d tempest-TestShelveInstance-1453332328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:14 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-4b5638bb-7f2a-4730-ac9f-9a5ea946e0c9 req-f01365db-78e7-4a03-96fd-5fa3a2214b3d tempest-TestShelveInstance-1453332328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-0e342c35-b7e8-4965-b888-75b781cbbcf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2780b40-cf4d-4aff-8cf8-81b1b24d1be9', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:17:14 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-4b5638bb-7f2a-4730-ac9f-9a5ea946e0c9 req-f01365db-78e7-4a03-96fd-5fa3a2214b3d tempest-TestShelveInstance-1453332328 None] attachment_update completed successfully. Sep 17 17:17:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-1f9129da-ea06-4a0a-9e16-8d2753bb4a19-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-1f9129da-ea06-4a0a-9e16-8d2753bb4a19-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca7f2f5-be36-4bcd-87b1-710a48b9f7a6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:14 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 Sep 17 17:17:14 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:15 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" returned: 0 in 0.464s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:15 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19 Sep 17 17:17:15 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:15 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" returned: 0 in 0.419s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-1f9129da-ea06-4a0a-9e16-8d2753bb4a19" released by "delete_volume" :: held 0.999s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Created reservations ['f1997cfb-ebd0-40f1-876f-85a731063b2b', '74198e62-f546-4d79-8790-bb27170a1ceb', '672edaa9-9a8b-48fc-bcad-ac15b85c8f5d', '50eb4c4f-f5b0-4b13-a346-48460849c343'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:15 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:17:15 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:15 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.257s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:15 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:17:15 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Deleted volume successfully. Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-97884fd7-ed90-4218-bc10-c5d4e2628b40 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-1f9129da-ea06-4a0a-9e16-8d2753bb4a19-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6c69e908-21f1-4ff4-abe8-9021e1774f30 req-ca09c3ee-fc1c-4714-95ef-996f64bb0599 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6c69e908-21f1-4ff4-abe8-9021e1774f30 req-ca09c3ee-fc1c-4714-95ef-996f64bb0599 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-6c69e908-21f1-4ff4-abe8-9021e1774f30 req-ca09c3ee-fc1c-4714-95ef-996f64bb0599 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-6c69e908-21f1-4ff4-abe8-9021e1774f30 req-ca09c3ee-fc1c-4714-95ef-996f64bb0599 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-92e71f25-80ad-4691-b8d3-a04f232ed095', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5da2cf5-bc7d-4774-8a02-c633cab857f4', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:17:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-6c69e908-21f1-4ff4-abe8-9021e1774f30 req-ca09c3ee-fc1c-4714-95ef-996f64bb0599 tempest-TestServerVolumeAttachmentScenario-1811813920 None] attachment_update completed successfully. Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-f003d06e-a1d0-445a-8de9-9a2da417a37e-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-f003d06e-a1d0-445a-8de9-9a2da417a37e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-f003d06e-a1d0-445a-8de9-9a2da417a37e" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-f003d06e-a1d0-445a-8de9-9a2da417a37e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Deleting offline snapshot f003d06e-a1d0-445a-8de9-9a2da417a37e of volume 4c0b1e71-791c-48f9-b6f3-d85bce41eae2 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] snapshot_file for this snap is: volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08fb891-56b9-456e-9e99-89d4b5707b06]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:17 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e Sep 17 17:17:17 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:17 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e" returned: 0 in 0.715s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:17:17 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[99758922-99d2-42a6-8b1d-2c59201bf9aa]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:17 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 Sep 17 17:17:17 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:18 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" returned: 0 in 0.808s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:18 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e Sep 17 17:17:18 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:18 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:18 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e Sep 17 17:17:18 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:19 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2.f003d06e-a1d0-445a-8de9-9a2da417a37e" returned: 0 in 0.371s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-f003d06e-a1d0-445a-8de9-9a2da417a37e" released by "_delete_snapshot" :: held 2.453s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" released by "delete_snapshot" :: held 2.485s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:19 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Created reservations ['907aeb98-7fc3-48a6-ad1b-5f52b5f6d90e', 'd44f4932-6071-466c-b198-4d56804a7738', 'b8666065-6140-45ce-a644-12636f6ec208', 'b69d20f8-8a6a-4c9d-aa95-b3db1f972d43'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:17:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Delete snapshot completed successfully. Sep 17 17:17:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49b06d6e-2f07-4c98-b2a2-ed43ca8f2323 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-f003d06e-a1d0-445a-8de9-9a2da417a37e-delete_snapshot" released by "delete_snapshot" :: held 2.683s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-4c0b1e71-791c-48f9-b6f3-d85bce41eae2-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-4c0b1e71-791c-48f9-b6f3-d85bce41eae2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:20 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[818ef8f0-6db9-4b75-976d-0a5879483f3a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:20 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 Sep 17 17:17:20 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:20 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" returned: 0 in 0.469s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:20 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2 Sep 17 17:17:20 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:21 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" returned: 0 in 0.297s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-4c0b1e71-791c-48f9-b6f3-d85bce41eae2" released by "delete_volume" :: held 0.879s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Created reservations ['23dcf83d-086f-4127-b65e-2ad56fae623a', 'f88fa32d-4309-4f5c-a9a2-8fdb053c376a', '7607c765-89eb-46f3-aac9-a87a9481d8a6', '8c957cd4-fa58-4bfe-9a95-1b63c4b6cbeb'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:21 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:17:21 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:21 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.521s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:21 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:17:21 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Deleted volume successfully. Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-760f47ff-62c5-4992-9dca-a1930ea0f007 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-4c0b1e71-791c-48f9-b6f3-d85bce41eae2-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:22 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:17:22 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Flow 'volume_create_manager' (e1feef4f-e8a4-4b5c-aa10-3ebc2a618308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8868ce-0256-40b2-9241-d3ace3a2118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-5235c718-e0ec-42d1-aa59-937f8ab55fcc req-590d28d7-a186-4a57-b6ef-9e818590d8ce tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-5235c718-e0ec-42d1-aa59-937f8ab55fcc req-590d28d7-a186-4a57-b6ef-9e818590d8ce tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8868ce-0256-40b2-9241-d3ace3a2118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2118361558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0c2d2f-5296-44dc-a83e-8d8be429ec52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8680f9274e54b7ba9090deb045b6c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:17:23Z,use_quota=True,user_id='cc9717b24b3e43db9f3b369bfebfbbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c36888f-8b2b-4aad-8bd0-19b082b54548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c36888f-8b2b-4aad-8bd0-19b082b54548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edac6d81-d74c-4bee-aadb-2a3218f909ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:22 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edac6d81-d74c-4bee-aadb-2a3218f909ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d0c2d2f-5296-44dc-a83e-8d8be429ec52', 'volume_name': 'volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e64957-909c-46c5-8df8-a4417ce39c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e64957-909c-46c5-8df8-a4417ce39c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f055bc8-93b3-4fb1-baf4-4ad37de67226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:22 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Volume 0d0c2d2f-5296-44dc-a83e-8d8be429ec52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52', 'volume_size': 1} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.494s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-5235c718-e0ec-42d1-aa59-937f8ab55fcc req-590d28d7-a186-4a57-b6ef-9e818590d8ce tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.098s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2118361558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0c2d2f-5296-44dc-a83e-8d8be429ec52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8680f9274e54b7ba9090deb045b6c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:17:23Z,use_quota=True,user_id='cc9717b24b3e43db9f3b369bfebfbbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Creating volume 0d0c2d2f-5296-44dc-a83e-8d8be429ec52 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:17:22 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:22 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 1073741824 Sep 17 17:17:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-5235c718-e0ec-42d1-aa59-937f8ab55fcc req-590d28d7-a186-4a57-b6ef-9e818590d8ce tempest-TestServerVolumeAttachmentScenario-1811813920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-462027de-6d56-4fa8-9777-6416b89a8a71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0005064-7159-40a0-8266-4a3154489505', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:17:22 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:23 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-5235c718-e0ec-42d1-aa59-937f8ab55fcc req-590d28d7-a186-4a57-b6ef-9e818590d8ce tempest-TestServerVolumeAttachmentScenario-1811813920 None] attachment_update completed successfully. Sep 17 17:17:23 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 1073741824" returned: 0 in 0.867s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:23 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 Sep 17 17:17:23 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:24 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" returned: 0 in 0.296s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f055bc8-93b3-4fb1-baf4-4ad37de67226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e089ab0a-ed91-480f-8a5d-b20ae4475c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:24 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Volume volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 (0d0c2d2f-5296-44dc-a83e-8d8be429ec52): created successfully Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e089ab0a-ed91-480f-8a5d-b20ae4475c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Flow 'volume_create_manager' (e1feef4f-e8a4-4b5c-aa10-3ebc2a618308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:24 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b2d25ccd-785d-4cd0-830c-e1dbf29bbd3c tempest-VolumesSnapshotTestJSON-1666238325 None] Created volume successfully. Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Creating offline snapshot f092bcf3-fcc9-4646-a683-4a5e69790d47 of volume 0d0c2d2f-5296-44dc-a83e-8d8be429ec52 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea32185e-e777-45f3-a41e-53583a3a0066]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:25 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 Sep 17 17:17:25 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:25 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-26b25b66-e720-47e8-b68d-f94914a1fa95 req-2b06431d-2c46-4767-86b2-76514e85225c tempest-TestServerVolumeAttachmentScenario-1811813920 None] Terminate volume connection completed successfully. Sep 17 17:17:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-26b25b66-e720-47e8-b68d-f94914a1fa95 req-2b06431d-2c46-4767-86b2-76514e85225c tempest-TestServerVolumeAttachmentScenario-1811813920 None] Deleting attachment d0005064-7159-40a0-8266-4a3154489505. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:17:25 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" returned: 0 in 0.509s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:25 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 1G Sep 17 17:17:25 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:25 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 1G" returned: 0 in 0.434s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:25 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 Sep 17 17:17:25 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:26 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47" returned: 0 in 0.320s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:26 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 is being set with open permissions: ugo+rw Sep 17 17:17:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:26 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 Sep 17 17:17:26 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:26 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47" returned: 0 in 0.305s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:26 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.info Sep 17 17:17:26 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:26 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-250c79fc-eab2-4687-a080-1da3d63b6808 req-63ff30b4-66f3-4866-8bcc-8e21d0ceb604 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Terminate volume connection completed successfully. Sep 17 17:17:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-250c79fc-eab2-4687-a080-1da3d63b6808 req-63ff30b4-66f3-4866-8bcc-8e21d0ceb604 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Deleting attachment a5da2cf5-bc7d-4774-8a02-c633cab857f4. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:17:26 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.info" returned: 0 in 0.288s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:26 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.info is being set with open permissions: ugo+rw Sep 17 17:17:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:26 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.info Sep 17 17:17:26 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:27 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.info" returned: 0 in 0.259s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:27 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-929e879c-a88c-4368-be8d-f89eaa8bc874 tempest-VolumesSnapshotTestJSON-1666238325 None] Create snapshot completed successfully Sep 17 17:17:28 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:17:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Flow 'volume_create_manager' (a2fa551c-39f3-421c-abdf-0c3d0fd456ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4eb757-79a4-4360-9956-d56bdf83b542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4eb757-79a4-4360-9956-d56bdf83b542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-662726475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45161fe2-7994-4094-9e6e-82cddb1dff2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8680f9274e54b7ba9090deb045b6c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f092bcf3-fcc9-4646-a683-4a5e69790d47,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:17:29Z,use_quota=True,user_id='cc9717b24b3e43db9f3b369bfebfbbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bbafea-fd2a-4f90-80f9-1966189b6ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bbafea-fd2a-4f90-80f9-1966189b6ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2369de90-65c7-4a29-88d8-7fb408b40c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2369de90-65c7-4a29-88d8-7fb408b40c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45161fe2-7994-4094-9e6e-82cddb1dff2e', 'volume_name': 'volume-45161fe2-7994-4094-9e6e-82cddb1dff2e', 'volume_size': 1, 'snapshot_id': 'f092bcf3-fcc9-4646-a683-4a5e69790d47'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a22037c-7822-4c75-a9a1-05f662e6d7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a22037c-7822-4c75-a9a1-05f662e6d7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc8a92c-34f9-4f90-beed-182e99b0a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:29 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Volume 45161fe2-7994-4094-9e6e-82cddb1dff2e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45161fe2-7994-4094-9e6e-82cddb1dff2e', 'volume_size': 1, 'snapshot_id': 'f092bcf3-fcc9-4646-a683-4a5e69790d47'} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-f092bcf3-fcc9-4646-a683-4a5e69790d47-45161fe2-7994-4094-9e6e-82cddb1dff2e" by "_create_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-f092bcf3-fcc9-4646-a683-4a5e69790d47-45161fe2-7994-4094-9e6e-82cddb1dff2e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Creating volume 45161fe2-7994-4094-9e6e-82cddb1dff2e from snapshot f092bcf3-fcc9-4646-a683-4a5e69790d47 {{(pid=85889) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-45161fe2-7994-4094-9e6e-82cddb1dff2e" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-45161fe2-7994-4094-9e6e-82cddb1dff2e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] snapshot: f092bcf3-fcc9-4646-a683-4a5e69790d47, volume: 45161fe2-7994-4094-9e6e-82cddb1dff2e, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[862fe5cb-859b-4338-b398-09c9d7995910]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:29 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 Sep 17 17:17:29 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:29 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47" returned: 0 in 0.458s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f950d5-ebea-4a3d-8f94-f2e2ca243301]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:29 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 Sep 17 17:17:29 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:30 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" returned: 0 in 0.526s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:17:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:17:30 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:17:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:30 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e Sep 17 17:17:30 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "cinder-462027de-6d56-4fa8-9777-6416b89a8a71-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "cinder-462027de-6d56-4fa8-9777-6416b89a8a71-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "cinder-quobyte-462027de-6d56-4fa8-9777-6416b89a8a71" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "cinder-quobyte-462027de-6d56-4fa8-9777-6416b89a8a71" acquired by "delete_volume" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:33 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c216d9e6-f195-440b-8a40-4aaa96cc1ae0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:33 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71 Sep 17 17:17:33 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:33 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71" returned: 0 in 0.875s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:33 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71 Sep 17 17:17:33 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:34 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-462027de-6d56-4fa8-9777-6416b89a8a71" returned: 0 in 0.700s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "cinder-quobyte-462027de-6d56-4fa8-9777-6416b89a8a71" released by "delete_volume" :: held 1.685s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:34 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Created reservations ['3d0268e7-3598-4cfb-875d-da070735b30e', 'c82c4f1a-77ac-4d20-a9aa-66b3d9f6e993', '9ad919b2-517e-41a7-8ff1-63bff9328ad0', '9b19fed4-10ab-4722-93b2-d8bf86e13ff5'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:17:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:34 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:17:34 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "cinder-92e71f25-80ad-4691-b8d3-a04f232ed095-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:35 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.520s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:35 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:17:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "cinder-92e71f25-80ad-4691-b8d3-a04f232ed095-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:35 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Deleted volume successfully. Sep 17 17:17:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f76f3aee-1e5d-4349-a0ae-b8716cfb830f tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "cinder-462027de-6d56-4fa8-9777-6416b89a8a71-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "cinder-quobyte-92e71f25-80ad-4691-b8d3-a04f232ed095" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "cinder-quobyte-92e71f25-80ad-4691-b8d3-a04f232ed095" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:35 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ffe37a-3ca1-4252-b24b-c816f382490b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:35 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095 Sep 17 17:17:35 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:36 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095" returned: 0 in 0.639s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:36 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095 Sep 17 17:17:36 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:36 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-92e71f25-80ad-4691-b8d3-a04f232ed095" returned: 0 in 0.376s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "cinder-quobyte-92e71f25-80ad-4691-b8d3-a04f232ed095" released by "delete_volume" :: held 1.128s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:36 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Created reservations ['23da0f2d-5f69-40f8-8666-421ba9e56095', 'f5be6da7-90eb-4a51-b1f6-51cda6fbaf02', 'ac4369d1-4d96-4c48-8cb3-9edadf20c6ae', '8e70e6fb-9c1c-4383-b7c0-36d579447b26'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:17:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:37 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:17:37 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:37 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.404s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:37 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:17:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Deleted volume successfully. Sep 17 17:17:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d30adaa2-c36f-4b2d-9bdd-5471f555ace2 tempest-TestServerVolumeAttachmentScenario-1811813920 None] Lock "cinder-92e71f25-80ad-4691-b8d3-a04f232ed095-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:38 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e" returned: 0 in 8.730s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:38 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:17:38 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Converted 1024.00 MB image at 117.28 MB/s Sep 17 17:17:38 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e is being set with open permissions: ugo+rw Sep 17 17:17:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:38 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e Sep 17 17:17:38 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:39 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e" returned: 0 in 0.264s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-45161fe2-7994-4094-9e6e-82cddb1dff2e" released by "_copy_volume_from_snapshot" :: held 10.097s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-f092bcf3-fcc9-4646-a683-4a5e69790d47-45161fe2-7994-4094-9e6e-82cddb1dff2e" released by "_create_volume_from_snapshot" :: held 10.160s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.178s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc8a92c-34f9-4f90-beed-182e99b0a808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45161fe2-7994-4094-9e6e-82cddb1dff2e', 'volume_size': 1, 'snapshot_id': 'f092bcf3-fcc9-4646-a683-4a5e69790d47'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43bfdb12-36be-4654-8f24-d2316a77c4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:39 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Volume volume-45161fe2-7994-4094-9e6e-82cddb1dff2e (45161fe2-7994-4094-9e6e-82cddb1dff2e): created successfully Sep 17 17:17:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43bfdb12-36be-4654-8f24-d2316a77c4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Flow 'volume_create_manager' (a2fa551c-39f3-421c-abdf-0c3d0fd456ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:39 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-09e90363-20fd-4c50-a291-e7407af7088a tempest-VolumesSnapshotTestJSON-1666238325 None] Created volume successfully. Sep 17 17:17:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-45161fe2-7994-4094-9e6e-82cddb1dff2e-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-45161fe2-7994-4094-9e6e-82cddb1dff2e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-45161fe2-7994-4094-9e6e-82cddb1dff2e" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-45161fe2-7994-4094-9e6e-82cddb1dff2e" acquired by "delete_volume" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:40 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a0c062-2766-4d23-860e-f941cc2365e2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:40 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e Sep 17 17:17:40 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:40 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e" returned: 0 in 0.379s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:40 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e Sep 17 17:17:40 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:41 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-45161fe2-7994-4094-9e6e-82cddb1dff2e" returned: 0 in 0.254s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-45161fe2-7994-4094-9e6e-82cddb1dff2e" released by "delete_volume" :: held 0.683s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=72,cinder:SELECT=97,cinder:INSERT=26,cinder:DELETE=4 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=92,cinder:UPDATE=74,cinder:DELETE=9,cinder:INSERT=20 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Created reservations ['babe2a3a-418f-4cdb-84b9-cff389848436', '025bd86a-a613-456c-a52f-ca76baca17dd', '29c15c81-3ad6-42cd-9fd4-5c4c852c32a6', '5973a4a8-2340-41ea-a50e-ff97766d118e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:41 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:17:41 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:41 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.255s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:17:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Deleted volume successfully. Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-74801751-9f05-444b-9d38-6db6f25d8c1a tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-45161fe2-7994-4094-9e6e-82cddb1dff2e-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-f092bcf3-fcc9-4646-a683-4a5e69790d47-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-f092bcf3-fcc9-4646-a683-4a5e69790d47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-f092bcf3-fcc9-4646-a683-4a5e69790d47" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-f092bcf3-fcc9-4646-a683-4a5e69790d47" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Deleting offline snapshot f092bcf3-fcc9-4646-a683-4a5e69790d47 of volume 0d0c2d2f-5296-44dc-a83e-8d8be429ec52 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] snapshot_file for this snap is: volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d32cc1e-e2fc-4161-b5dd-8ea2ef268970]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:41 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 Sep 17 17:17:41 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:42 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47" returned: 0 in 0.378s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:17:42 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73233b9-78b2-48a5-9df9-0285d34a98b2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:42 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 Sep 17 17:17:42 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:42 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" returned: 0 in 0.615s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:42 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 Sep 17 17:17:42 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:43 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47" returned: 0 in 0.331s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:43 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47 Sep 17 17:17:43 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:43 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52.f092bcf3-fcc9-4646-a683-4a5e69790d47" returned: 0 in 0.362s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-f092bcf3-fcc9-4646-a683-4a5e69790d47" released by "_delete_snapshot" :: held 1.809s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" released by "delete_snapshot" :: held 1.841s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Created reservations ['94010172-bd8c-42ae-b409-2df96a767475', '781e1598-7b40-4c16-9ce9-0cd5775ca385', '3a3876d3-594c-4337-b03e-a452be6381ac', '969a8c4c-40a0-4d87-9db9-e78403690b27'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:17:43 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Delete snapshot completed successfully. Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2243398-eb86-4e64-aad2-b53f243d64a7 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-f092bcf3-fcc9-4646-a683-4a5e69790d47-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-0d0c2d2f-5296-44dc-a83e-8d8be429ec52-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-0d0c2d2f-5296-44dc-a83e-8d8be429ec52-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[460d7e3a-b238-4f8e-b29c-fb02ea4b35ea]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:44 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 Sep 17 17:17:44 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:44 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" returned: 0 in 0.410s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:44 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52 Sep 17 17:17:44 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:44 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" returned: 0 in 0.271s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-0d0c2d2f-5296-44dc-a83e-8d8be429ec52" released by "delete_volume" :: held 0.777s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Created reservations ['cda9ef28-7984-4644-8d3b-6ab806e86d4f', '725054f7-3777-49b6-83db-8b4eed797344', 'b84cdb2f-879e-4f1b-b805-aaa918808412', 'ad9bd53f-7632-413a-9b24-619f4403e8de'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:44 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:17:44 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:45 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-9622b85d-dd60-41ef-9fdf-e41c2f81505e-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.298s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:17:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Deleted volume successfully. Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-9622b85d-dd60-41ef-9fdf-e41c2f81505e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b4619647-a305-429a-865b-1fbeca24de58 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-0d0c2d2f-5296-44dc-a83e-8d8be429ec52-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "cinder-quobyte-9622b85d-dd60-41ef-9fdf-e41c2f81505e" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-9622b85d-dd60-41ef-9fdf-e41c2f81505e" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6f326e-e08c-4476-8344-7b52b3d373c0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:45 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e Sep 17 17:17:45 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:45 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e" returned: 0 in 0.416s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:45 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e Sep 17 17:17:45 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:45 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-9622b85d-dd60-41ef-9fdf-e41c2f81505e" returned: 0 in 0.243s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-quobyte-9622b85d-dd60-41ef-9fdf-e41c2f81505e" released by "delete_volume" :: held 0.735s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:46 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Created reservations ['167fe44e-6751-4053-a0a9-1b9d5f662e70', 'e8454779-eff4-416e-84bc-115a8595ebf1', 'a8bdeb71-6fdc-461d-a7e8-994549475333', '4fb74aa0-3dac-4312-8cc6-7f845261dfc0'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:17:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:46 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:17:46 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:46 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.312s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:46 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:17:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Deleted volume successfully. Sep 17 17:17:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-28936b43-b7ac-4775-be75-06d7070a16a9 tempest-VolumesSnapshotTestJSON-1666238325 None] Lock "cinder-9622b85d-dd60-41ef-9fdf-e41c2f81505e-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:51 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-5d4c128f-715d-484d-8742-0fd45f80a89f req-1aff3c90-772a-404b-881c-8725edcf518b tempest-TestShelveInstance-1453332328 None] Terminate volume connection completed successfully. Sep 17 17:17:51 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-5d4c128f-715d-484d-8742-0fd45f80a89f req-1aff3c90-772a-404b-881c-8725edcf518b tempest-TestShelveInstance-1453332328 None] Deleting attachment d2780b40-cf4d-4aff-8cf8-81b1b24d1be9. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Flow 'volume_create_manager' (e6126f78-cfd4-4ca4-b185-b2f5e3434d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3569def-e250-4601-8629-701a491da7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3569def-e250-4601-8629-701a491da7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580141895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9688acb8c48643e48f5f04e1f879c0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:17:53Z,use_quota=True,user_id='e8a1d33aa1c14f599d2732b0550f7892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546200d8-1950-4c23-bb8d-5aa3a669e31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546200d8-1950-4c23-bb8d-5aa3a669e31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62a6c48-8b7d-420b-af54-9b29bfe06520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62a6c48-8b7d-420b-af54-9b29bfe06520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb', 'volume_name': 'volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c61acd-319c-4f69-a1e4-c5b41553ded3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c61acd-319c-4f69-a1e4-c5b41553ded3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70aba86e-31b2-4f62-8c5b-65e264e69b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:52 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Volume 95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb', 'volume_size': 1} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580141895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9688acb8c48643e48f5f04e1f879c0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:17:53Z,use_quota=True,user_id='e8a1d33aa1c14f599d2732b0550f7892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Creating volume 95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:17:52 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:17:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:52 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb 1073741824 Sep 17 17:17:52 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:53 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb 1073741824" returned: 0 in 0.525s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:53 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb Sep 17 17:17:53 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:53 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb" returned: 0 in 0.332s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:17:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70aba86e-31b2-4f62-8c5b-65e264e69b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ff2927-7fac-44d8-b96a-50205dc2cffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:53 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Volume volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb (95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb): created successfully Sep 17 17:17:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ff2927-7fac-44d8-b96a-50205dc2cffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Flow 'volume_create_manager' (e6126f78-cfd4-4ca4-b185-b2f5e3434d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:53 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6060a1bb-3ef4-4739-84ad-2fd19e11b3b0 tempest-ProjectReaderTests-1088148890 None] Created volume successfully. Sep 17 17:17:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-b2564424-bb3f-42f5-9c68-fc2751a34c02 req-ef206a9d-7424-4d67-becf-a63f9856bd40 tempest-TestShelveInstance-1453332328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-b2564424-bb3f-42f5-9c68-fc2751a34c02 req-ef206a9d-7424-4d67-becf-a63f9856bd40 tempest-TestShelveInstance-1453332328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-b2564424-bb3f-42f5-9c68-fc2751a34c02 req-ef206a9d-7424-4d67-becf-a63f9856bd40 tempest-TestShelveInstance-1453332328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-b2564424-bb3f-42f5-9c68-fc2751a34c02 req-ef206a9d-7424-4d67-becf-a63f9856bd40 tempest-TestShelveInstance-1453332328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189', 'name': 'volume-0e342c35-b7e8-4965-b888-75b781cbbcf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17bafaf6-624f-4e70-8593-2ab03774ec6c', 'enforce_multipath': True} {{(pid=85889) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 17:17:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-b2564424-bb3f-42f5-9c68-fc2751a34c02 req-ef206a9d-7424-4d67-becf-a63f9856bd40 tempest-TestShelveInstance-1453332328 None] attachment_update completed successfully. Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Acquiring lock "cinder-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Lock "cinder-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Acquiring lock "cinder-quobyte-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Lock "cinder-quobyte-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb" acquired by "delete_volume" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f036389d-b42f-407f-9dcd-c341c849c91d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:55 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb Sep 17 17:17:55 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:55 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb" returned: 0 in 0.417s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:55 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb Sep 17 17:17:55 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:55 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb" returned: 0 in 0.277s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Lock "cinder-quobyte-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb" released by "delete_volume" :: held 0.748s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:55 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Created reservations ['88bf420a-2f30-4461-879f-32dfda765f41', 'b93a9beb-122a-4ee9-8ba9-73e3ff829e59', '085623c7-cd1f-41cb-bd7e-04ca9ccbc496', '18d59d89-8648-4b36-a1af-3635b61ee54d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:56 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:17:56 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:56 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.347s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:17:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Deleted volume successfully. Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7e675c57-acda-4d5b-bc5b-040e4848ddd5 tempest-ProjectReaderTests-1088148890 None] Lock "cinder-95d74ce2-ade9-4fdb-86f0-aa2a8930e0eb-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Flow 'volume_create_manager' (3c377071-5701-48c8-9b2e-79b19682a97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93886cc-174b-4fe4-a158-fff907587b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93886cc-174b-4fe4-a158-fff907587b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-930432559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472b7583-0194-4784-ac88-6d480f5a8d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9688acb8c48643e48f5f04e1f879c0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:17:57Z,use_quota=True,user_id='e8a1d33aa1c14f599d2732b0550f7892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e18c644-66db-4ed3-89cb-aa12a22f6b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e18c644-66db-4ed3-89cb-aa12a22f6b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40984862-d1ac-43e0-81d8-c75292b12bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40984862-d1ac-43e0-81d8-c75292b12bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '472b7583-0194-4784-ac88-6d480f5a8d2f', 'volume_name': 'volume-472b7583-0194-4784-ac88-6d480f5a8d2f', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925eef84-e683-4b67-9445-f9ad6cefaac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925eef84-e683-4b67-9445-f9ad6cefaac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f89889-b404-4a80-b56f-b327491e33d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:56 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Volume 472b7583-0194-4784-ac88-6d480f5a8d2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-472b7583-0194-4784-ac88-6d480f5a8d2f', 'volume_size': 1} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-930432559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472b7583-0194-4784-ac88-6d480f5a8d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9688acb8c48643e48f5f04e1f879c0a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:17:57Z,use_quota=True,user_id='e8a1d33aa1c14f599d2732b0550f7892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Creating volume 472b7583-0194-4784-ac88-6d480f5a8d2f {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:17:56 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:17:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:56 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f 1073741824 Sep 17 17:17:56 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:57 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f 1073741824" returned: 0 in 0.629s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:57 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f Sep 17 17:17:57 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:58 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f" returned: 0 in 0.433s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:17:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:17:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f89889-b404-4a80-b56f-b327491e33d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-472b7583-0194-4784-ac88-6d480f5a8d2f', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4d1959-b734-4b8d-8c45-149a71295eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:17:58 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Volume volume-472b7583-0194-4784-ac88-6d480f5a8d2f (472b7583-0194-4784-ac88-6d480f5a8d2f): created successfully Sep 17 17:17:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4d1959-b734-4b8d-8c45-149a71295eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:17:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Flow 'volume_create_manager' (3c377071-5701-48c8-9b2e-79b19682a97f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:17:58 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-37d2c8c3-bfe5-4561-929b-55b32dea4ee0 tempest-ProjectReaderTests-1088148890 None] Created volume successfully. Sep 17 17:17:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Acquiring lock "cinder-472b7583-0194-4784-ac88-6d480f5a8d2f-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Lock "cinder-472b7583-0194-4784-ac88-6d480f5a8d2f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Acquiring lock "cinder-quobyte-472b7583-0194-4784-ac88-6d480f5a8d2f" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:17:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Lock "cinder-quobyte-472b7583-0194-4784-ac88-6d480f5a8d2f" acquired by "delete_volume" :: waited 0.038s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:17:59 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b97470-28b1-4617-a3b4-cac1a9e5a0a0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:17:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:59 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f Sep 17 17:17:59 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:17:59 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 17 17:17:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f" returned: 0 in 0.529s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:17:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:17:59 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f Sep 17 17:17:59 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:00 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-472b7583-0194-4784-ac88-6d480f5a8d2f" returned: 0 in 0.300s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Lock "cinder-quobyte-472b7583-0194-4784-ac88-6d480f5a8d2f" released by "delete_volume" :: held 0.903s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Created reservations ['368f1509-58f2-41fb-b723-f5ba231eb6c6', '4681298f-ee18-49de-aeac-4473d98c6a08', 'b55aa384-fd3f-4044-99f5-2755748c046b', 'd1b39313-c2a8-4cd9-82ca-83448b39044f'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:00 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:18:00 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:00 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.342s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:18:00 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Deleted volume successfully. Sep 17 17:18:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-07777786-bb74-4e1d-b575-0fb151d3b8c3 tempest-ProjectReaderTests-1088148890 None] Lock "cinder-472b7583-0194-4784-ac88-6d480f5a8d2f-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:18:10 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=48,cinder:SELECT=36,cinder:DELETE=5,cinder:INSERT=13 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:18:10 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=43,cinder:INSERT=13,cinder:UPDATE=57,cinder:DELETE=2 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Flow 'volume_create_manager' (3ad50ec1-5925-4646-b3a1-5119501a5359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72671ad9-914e-42b8-bc62-a70d9ac416d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72671ad9-914e-42b8-bc62-a70d9ac416d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-421161676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9f559e-f716-4448-af8a-e45662675016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14596dc13424591b94464488ee61f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:17Z,use_quota=True,user_id='74cebfb3e4bf4279bf6cdec47ac3bd94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0913fc-5d53-4d9d-bae9-3a571f87223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0913fc-5d53-4d9d-bae9-3a571f87223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd65e7da-e386-4e71-a55e-12246462740b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd65e7da-e386-4e71-a55e-12246462740b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9f559e-f716-4448-af8a-e45662675016', 'volume_name': 'volume-dd9f559e-f716-4448-af8a-e45662675016', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887ee1c2-5959-4275-916d-efcc9c453971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887ee1c2-5959-4275-916d-efcc9c453971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6532d53b-8e43-431d-8eea-615866e9b858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:17 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Volume dd9f559e-f716-4448-af8a-e45662675016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9f559e-f716-4448-af8a-e45662675016', 'volume_size': 1} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-421161676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9f559e-f716-4448-af8a-e45662675016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14596dc13424591b94464488ee61f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:17Z,use_quota=True,user_id='74cebfb3e4bf4279bf6cdec47ac3bd94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Creating volume dd9f559e-f716-4448-af8a-e45662675016 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:18:17 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:17 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 1073741824 Sep 17 17:18:17 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:17 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 1073741824" returned: 0 in 0.397s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:18 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 Sep 17 17:18:18 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:18 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016" returned: 0 in 0.247s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:18:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6532d53b-8e43-431d-8eea-615866e9b858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9f559e-f716-4448-af8a-e45662675016', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4ab6a0-fbc7-4c41-b01f-4096d14606f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:18 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Volume volume-dd9f559e-f716-4448-af8a-e45662675016 (dd9f559e-f716-4448-af8a-e45662675016): created successfully Sep 17 17:18:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4ab6a0-fbc7-4c41-b01f-4096d14606f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Flow 'volume_create_manager' (3ad50ec1-5925-4646-b3a1-5119501a5359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:18 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-42a3fa05-3bb1-4f67-81a5-9af48757ccca tempest-TestImageHashVerification-14662632 None] Created volume successfully. Sep 17 17:18:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:19 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cf1360-af05-4cb5-a6c8-f9e81fd3561e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:18:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:19 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 Sep 17 17:18:19 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:19 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016" returned: 0 in 0.358s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:19 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f8e05e-367a-4d40-b233-8c6a8d141572]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:18:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:19 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 Sep 17 17:18:19 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:19 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 /opt/stack/data/cinder/conversion/dd9f559e-f716-4448-af8a-e45662675016.temp_image.2cb58bb7-9b3c-4177-97b2-19cd28822f838t4whw07.img {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:20 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 /opt/stack/data/cinder/conversion/dd9f559e-f716-4448-af8a-e45662675016.temp_image.2cb58bb7-9b3c-4177-97b2-19cd28822f838t4whw07.img Sep 17 17:18:20 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:22 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:18:22 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:22 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.529s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:18:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:18:26 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 /opt/stack/data/cinder/conversion/dd9f559e-f716-4448-af8a-e45662675016.temp_image.2cb58bb7-9b3c-4177-97b2-19cd28822f838t4whw07.img" returned: 0 in 6.388s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:26 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee66871-40a2-42e1-9c3f-647a4b3ebc5a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:18:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:26 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 Sep 17 17:18:26 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:26 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016" returned: 0 in 0.546s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:26 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/conversion/dd9f559e-f716-4448-af8a-e45662675016.temp_image.2cb58bb7-9b3c-4177-97b2-19cd28822f838t4whw07.img {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:18:26 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Converted 1024.00 MB image at 160.28 MB/s Sep 17 17:18:26 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] 2cb58bb7-9b3c-4177-97b2-19cd28822f83 was raw, no need to convert to raw {{(pid=85889) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 17 17:18:29 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:18:36 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:18:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-a2a579f9-cbeb-40e3-91b6-57700c2fbaa7 tempest-TestShelveInstance-1453332328 None] Terminate volume connection completed successfully. Sep 17 17:18:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-a2a579f9-cbeb-40e3-91b6-57700c2fbaa7 tempest-TestShelveInstance-1453332328 None] Deleting attachment 17bafaf6-624f-4e70-8593-2ab03774ec6c. {{(pid=85889) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 17:18:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Acquiring lock "cinder-0e342c35-b7e8-4965-b888-75b781cbbcf9-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:18:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Lock "cinder-0e342c35-b7e8-4965-b888-75b781cbbcf9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:18:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Acquiring lock "cinder-quobyte-0e342c35-b7e8-4965-b888-75b781cbbcf9" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:18:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Lock "cinder-quobyte-0e342c35-b7e8-4965-b888-75b781cbbcf9" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:18:40 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7904c099-dbb3-46e9-b4e9-f125c5235b55]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:18:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:40 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 Sep 17 17:18:40 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:41 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9" returned: 0 in 0.458s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:41 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9 Sep 17 17:18:41 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:41 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0e342c35-b7e8-4965-b888-75b781cbbcf9" returned: 0 in 0.286s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Lock "cinder-quobyte-0e342c35-b7e8-4965-b888-75b781cbbcf9" released by "delete_volume" :: held 0.814s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG cinder.quota [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Created reservations ['8f74f818-3302-4f51-bd2c-23f9e2c667e8', '2a7d83c9-3af2-456f-a5a7-438bbc107c29', 'cd11d03d-8654-456a-aeef-7199cc1bf22c', 'be6b8b0a-5553-4199-8f1f-a8c45e1914ee'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:41 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:18:41 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:41 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.303s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG cinder.manager [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:18:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Deleted volume successfully. Sep 17 17:18:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [req-2597bd04-6b13-4bad-bb0e-9014b4337551 req-beeb991a-920f-4c6c-a341-432796d9d824 tempest-TestShelveInstance-1453332328 None] Lock "cinder-0e342c35-b7e8-4965-b888-75b781cbbcf9-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:18:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.211s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Uploaded volume to glance image-id: 2cb58bb7-9b3c-4177-97b2-19cd28822f83. {{(pid=85889) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 17:18:47 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b017653e-7e96-44dc-9e6f-4d7d990265d4 tempest-TestImageHashVerification-14662632 None] Copy volume to image completed successfully. Sep 17 17:18:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Acquiring lock "cinder-dd9f559e-f716-4448-af8a-e45662675016-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:18:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Lock "cinder-dd9f559e-f716-4448-af8a-e45662675016-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:18:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Acquiring lock "cinder-quobyte-dd9f559e-f716-4448-af8a-e45662675016" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:18:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Lock "cinder-quobyte-dd9f559e-f716-4448-af8a-e45662675016" acquired by "delete_volume" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:18:48 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0777a8-51e1-49fd-a6a1-7b0b8148bf46]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:18:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:49 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 Sep 17 17:18:49 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:49 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016" returned: 0 in 0.398s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:49 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016 Sep 17 17:18:49 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:49 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd9f559e-f716-4448-af8a-e45662675016" returned: 0 in 0.246s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Lock "cinder-quobyte-dd9f559e-f716-4448-af8a-e45662675016" released by "delete_volume" :: held 0.686s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Created reservations ['f06b4e6b-3adc-426d-8ad1-911d984921e7', '93461850-1fff-4fdc-a34c-ea3d7887a502', '9e51b107-d707-4e71-a593-707224cf35cf', 'bb3e9691-41da-42ea-8990-a15c2b2a1f47'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:49 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:18:49 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:49 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.281s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:18:49 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Deleted volume successfully. Sep 17 17:18:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b58338d0-7963-45cb-af27-2440334e03ca tempest-TestImageHashVerification-14662632 None] Lock "cinder-dd9f559e-f716-4448-af8a-e45662675016-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (33412da8-501f-4b0d-a6f9-e3d8882f2711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1ddd14-1e2f-42fd-a0d6-7ba5882378e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1ddd14-1e2f-42fd-a0d6-7ba5882378e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-498575382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5068f679-1f56-474c-9837-ea81be84cdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:54Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4405ca-4f3d-4326-9bf6-6e22d58f6ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4405ca-4f3d-4326-9bf6-6e22d58f6ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c645967b-bedf-4a93-9943-f8ee20f8f6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c645967b-bedf-4a93-9943-f8ee20f8f6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5068f679-1f56-474c-9837-ea81be84cdb5', 'volume_name': 'volume-5068f679-1f56-474c-9837-ea81be84cdb5', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af87aee-5be2-4146-a53b-946c9f1a0907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af87aee-5be2-4146-a53b-946c9f1a0907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c8ec88-f5f3-4f67-8a28-2d927c8c7d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:54 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume 5068f679-1f56-474c-9837-ea81be84cdb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5068f679-1f56-474c-9837-ea81be84cdb5', 'volume_size': 1} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-498575382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5068f679-1f56-474c-9837-ea81be84cdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:54Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Creating volume 5068f679-1f56-474c-9837-ea81be84cdb5 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:18:54 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:18:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:54 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5 1073741824 Sep 17 17:18:54 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:55 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5 1073741824" returned: 0 in 0.451s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:55 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5 Sep 17 17:18:55 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:55 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:18:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c8ec88-f5f3-4f67-8a28-2d927c8c7d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5068f679-1f56-474c-9837-ea81be84cdb5', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daa48f3-93ca-41c8-a024-a7c8008e623d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:55 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume volume-5068f679-1f56-474c-9837-ea81be84cdb5 (5068f679-1f56-474c-9837-ea81be84cdb5): created successfully Sep 17 17:18:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daa48f3-93ca-41c8-a024-a7c8008e623d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (33412da8-501f-4b0d-a6f9-e3d8882f2711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:55 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-941aba59-06f9-4f18-8576-d320c3a91f53 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created volume successfully. Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (a3ea5090-7f27-4781-bcd9-4555afbcb570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326e1265-594d-41d8-bf93-961e22c1ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326e1265-594d-41d8-bf93-961e22c1ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235647412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64447d6a-57bb-42ad-9b62-d1124dd8d1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:56Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbeee7aa-f44d-4d7f-ab17-27694cb3abe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbeee7aa-f44d-4d7f-ab17-27694cb3abe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a54730-7308-4938-9fa1-2dba60256344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a54730-7308-4938-9fa1-2dba60256344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64447d6a-57bb-42ad-9b62-d1124dd8d1d1', 'volume_name': 'volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4104bf19-40f9-4e21-9c5b-e6372ad05be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4104bf19-40f9-4e21-9c5b-e6372ad05be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52a9bf7-a22f-4212-9446-f057a62ad4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume 64447d6a-57bb-42ad-9b62-d1124dd8d1d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1', 'volume_size': 1} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235647412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64447d6a-57bb-42ad-9b62-d1124dd8d1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:56Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Creating volume 64447d6a-57bb-42ad-9b62-d1124dd8d1d1 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:18:56 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:56 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1 1073741824 Sep 17 17:18:56 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (90e2fd74-12ad-4de3-9e82-9c7e8b4106ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addf096c-57a5-4338-ad66-87494e2dfc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addf096c-57a5-4338-ad66-87494e2dfc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762321899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f62df65-56d4-4725-87c7-98f9afe58895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:56Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dd7aa1-7095-4969-a1f4-72cee1bf5ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dd7aa1-7095-4969-a1f4-72cee1bf5ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bcdc46-5162-4d7e-98ae-0d6a291837c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bcdc46-5162-4d7e-98ae-0d6a291837c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f62df65-56d4-4725-87c7-98f9afe58895', 'volume_name': 'volume-3f62df65-56d4-4725-87c7-98f9afe58895', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73829405-7cfe-4cda-b400-bf6fa18792eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73829405-7cfe-4cda-b400-bf6fa18792eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d95e6a-972c-4c76-b8b5-aa0fa277e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume 3f62df65-56d4-4725-87c7-98f9afe58895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f62df65-56d4-4725-87c7-98f9afe58895', 'volume_size': 1} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:56 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1 1073741824" returned: 0 in 0.594s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (47c7be75-38fe-47d0-ba98-0cb63d5162b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5899d061-1014-46cb-b893-ee6952dd8887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5899d061-1014-46cb-b893-ee6952dd8887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-184711081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0528c6-715c-4009-ba12-79470a73ddd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:57Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1 Sep 17 17:18:56 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361328bd-7745-4948-a7dd-3b94f99235dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361328bd-7745-4948-a7dd-3b94f99235dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d28a64-ed8e-4888-952b-fa6c2b0887c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d28a64-ed8e-4888-952b-fa6c2b0887c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0528c6-715c-4009-ba12-79470a73ddd3', 'volume_name': 'volume-1d0528c6-715c-4009-ba12-79470a73ddd3', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bc2042-a66d-4496-974f-0a9a7335757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bc2042-a66d-4496-974f-0a9a7335757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93068992-01e5-4df6-8f31-b62c6cac5b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:56 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume 1d0528c6-715c-4009-ba12-79470a73ddd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0528c6-715c-4009-ba12-79470a73ddd3', 'volume_size': 1} Sep 17 17:18:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:57 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1" returned: 0 in 0.351s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.649s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762321899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f62df65-56d4-4725-87c7-98f9afe58895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:56Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Creating volume 3f62df65-56d4-4725-87c7-98f9afe58895 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:18:57 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:18:57 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895 1073741824 Sep 17 17:18:57 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (42b27550-4e73-4584-aa73-c7c3fdb72e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2377df2-8e01-40fe-afde-92a5159fc52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52a9bf7-a22f-4212-9446-f057a62ad4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9320f2ab-cc1a-4738-9f10-606e6bc4808a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2377df2-8e01-40fe-afde-92a5159fc52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1863499899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74ad519-5d45-4193-aef0-72eebcb034eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:57Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b76345a-0299-47b4-aa2a-a3fa84826b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b76345a-0299-47b4-aa2a-a3fa84826b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55d250c-c405-4207-836f-01ffca3a96a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55d250c-c405-4207-836f-01ffca3a96a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd74ad519-5d45-4193-aef0-72eebcb034eb', 'volume_name': 'volume-d74ad519-5d45-4193-aef0-72eebcb034eb', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167e4b36-0695-4480-987e-1603f0064921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167e4b36-0695-4480-987e-1603f0064921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef3ee2f-9baf-46a8-9399-6306a5905fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume d74ad519-5d45-4193-aef0-72eebcb034eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d74ad519-5d45-4193-aef0-72eebcb034eb', 'volume_size': 1} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:57 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1 (64447d6a-57bb-42ad-9b62-d1124dd8d1d1): created successfully Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9320f2ab-cc1a-4738-9f10-606e6bc4808a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (a3ea5090-7f27-4781-bcd9-4555afbcb570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:57 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c31239f8-0d3b-4733-8696-05858a85e1bd tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created volume successfully. Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (c55fea0d-ac76-4cc4-bf25-b616a1685ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8369f17-286d-46f9-9d8a-7caea0b730a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8369f17-286d-46f9-9d8a-7caea0b730a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085681717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21c89a6-c632-4662-a7e0-b18eed2be3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:58Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbb7ecf-3998-4fd3-9e8a-64fc669d4a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbb7ecf-3998-4fd3-9e8a-64fc669d4a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ad9f44-150d-49a2-ab64-e05f9661da68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ad9f44-150d-49a2-ab64-e05f9661da68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21c89a6-c632-4662-a7e0-b18eed2be3c9', 'volume_name': 'volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b1649f-fef8-435c-b658-41d74a6aae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b1649f-fef8-435c-b658-41d74a6aae40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d91ff3-1e63-4829-9065-438f262140ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:57 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume a21c89a6-c632-4662-a7e0-b18eed2be3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9', 'volume_size': 1} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:57 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895 1073741824" returned: 0 in 0.489s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:57 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895 Sep 17 17:18:57 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:58 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895" returned: 0 in 0.248s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-184711081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0528c6-715c-4009-ba12-79470a73ddd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:57Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Creating volume 1d0528c6-715c-4009-ba12-79470a73ddd3 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:18:58 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d95e6a-972c-4c76-b8b5-aa0fa277e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f62df65-56d4-4725-87c7-98f9afe58895', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:58 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3 1073741824 Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38910332-6fc7-4353-839b-381e76da5c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:58 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:58 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume volume-3f62df65-56d4-4725-87c7-98f9afe58895 (3f62df65-56d4-4725-87c7-98f9afe58895): created successfully Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38910332-6fc7-4353-839b-381e76da5c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (90e2fd74-12ad-4de3-9e82-9c7e8b4106ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:58 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-00aff2e8-e0b2-4522-b3f6-00a51196e227 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created volume successfully. Sep 17 17:18:58 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3 1073741824" returned: 0 in 0.535s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:58 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3 Sep 17 17:18:58 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:58 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3" returned: 0 in 0.277s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1863499899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74ad519-5d45-4193-aef0-72eebcb034eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:57Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Creating volume d74ad519-5d45-4193-aef0-72eebcb034eb {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:18:58 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93068992-01e5-4df6-8f31-b62c6cac5b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0528c6-715c-4009-ba12-79470a73ddd3', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:58 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb 1073741824 Sep 17 17:18:58 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7197feb-75f5-4b0d-8c2f-9f61f30e5b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:58 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume volume-1d0528c6-715c-4009-ba12-79470a73ddd3 (1d0528c6-715c-4009-ba12-79470a73ddd3): created successfully Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7197feb-75f5-4b0d-8c2f-9f61f30e5b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (47c7be75-38fe-47d0-ba98-0cb63d5162b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:59 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3feedb3e-966f-42f9-b346-caf42e974e11 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created volume successfully. Sep 17 17:18:59 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb 1073741824" returned: 0 in 0.486s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:59 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb Sep 17 17:18:59 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:59 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb" returned: 0 in 0.283s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085681717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21c89a6-c632-4662-a7e0-b18eed2be3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100e9d5e46354735920efdc11a5d500b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:18:58Z,use_quota=True,user_id='ad29d95b9e7548d1959dd88042003515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Creating volume a21c89a6-c632-4662-a7e0-b18eed2be3c9 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:18:59 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:18:59 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9 1073741824 Sep 17 17:18:59 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef3ee2f-9baf-46a8-9399-6306a5905fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74ad519-5d45-4193-aef0-72eebcb034eb', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecaf4e47-2512-4ead-b30b-805cd3593b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:18:59 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume volume-d74ad519-5d45-4193-aef0-72eebcb034eb (d74ad519-5d45-4193-aef0-72eebcb034eb): created successfully Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecaf4e47-2512-4ead-b30b-805cd3593b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:18:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (42b27550-4e73-4584-aa73-c7c3fdb72e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:18:59 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-fd53c88d-ef68-4a04-b60c-a11d7a8bcb27 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created volume successfully. Sep 17 17:19:00 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9 1073741824" returned: 0 in 0.483s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:00 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9 Sep 17 17:19:00 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:00 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9" returned: 0 in 0.246s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:19:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d91ff3-1e63-4829-9065-438f262140ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea37e32-068a-43df-bc15-f22864c2a0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:00 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Volume volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9 (a21c89a6-c632-4662-a7e0-b18eed2be3c9): created successfully Sep 17 17:19:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea37e32-068a-43df-bc15-f22864c2a0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Flow 'volume_create_manager' (c55fea0d-ac76-4cc4-bf25-b616a1685ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:00 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-991570c9-65ac-466e-93c9-f33c250b478f tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created volume successfully. Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-a21c89a6-c632-4662-a7e0-b18eed2be3c9-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-a21c89a6-c632-4662-a7e0-b18eed2be3c9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-quobyte-a21c89a6-c632-4662-a7e0-b18eed2be3c9" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-a21c89a6-c632-4662-a7e0-b18eed2be3c9" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb29095-4dfa-497c-8ab3-a4a236bb0ebf]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:01 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9 Sep 17 17:19:01 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:01 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9" returned: 0 in 0.395s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:01 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9 Sep 17 17:19:01 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:01 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a21c89a6-c632-4662-a7e0-b18eed2be3c9" returned: 0 in 0.247s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-a21c89a6-c632-4662-a7e0-b18eed2be3c9" released by "delete_volume" :: held 0.687s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created reservations ['a68d640a-5beb-4995-91f1-a716ec02b9d7', '634fac13-5862-4bf7-8b35-65360ad4c60b', 'a9c2da31-d34c-4e89-9c29-6f0a89358b81', '9dc9a641-1dd3-4051-b846-5a1359fb6624'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:01 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:01 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:02 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.260s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Deleted volume successfully. Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-d74ad519-5d45-4193-aef0-72eebcb034eb-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-96fa494f-6266-476c-9289-6533b1be1a7a tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-a21c89a6-c632-4662-a7e0-b18eed2be3c9-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-d74ad519-5d45-4193-aef0-72eebcb034eb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-quobyte-d74ad519-5d45-4193-aef0-72eebcb034eb" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-d74ad519-5d45-4193-aef0-72eebcb034eb" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81434ed-06c3-42e1-9cd1-8f50abeddc5b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Flow 'volume_create_manager' (465159a3-88ee-4ca0-93d5-c740243fdbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d1b90d-6b4f-477c-8581-35aa543659c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d1b90d-6b4f-477c-8581-35aa543659c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48095bf8-3ec5-4c22-a90f-facd50540277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ce3f16136c46a2a393193e57949c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:02Z,use_quota=True,user_id='f0bf655948d04dc692d8f5becf57e4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:02 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb Sep 17 17:19:02 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17260889-f149-4e27-926f-4446d00b1819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17260889-f149-4e27-926f-4446d00b1819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c2efd2-e195-4ed5-a692-27df0bba5293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c2efd2-e195-4ed5-a692-27df0bba5293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48095bf8-3ec5-4c22-a90f-facd50540277', 'volume_name': 'volume-48095bf8-3ec5-4c22-a90f-facd50540277', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eca93df-2bbd-4852-a97b-f355eff9b4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eca93df-2bbd-4852-a97b-f355eff9b4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4742560b-f426-4157-a246-4fb939246725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:02 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Volume 48095bf8-3ec5-4c22-a90f-facd50540277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48095bf8-3ec5-4c22-a90f-facd50540277', 'volume_size': 1} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48095bf8-3ec5-4c22-a90f-facd50540277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ce3f16136c46a2a393193e57949c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:02Z,use_quota=True,user_id='f0bf655948d04dc692d8f5becf57e4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Creating volume 48095bf8-3ec5-4c22-a90f-facd50540277 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:19:02 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:02 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277 1073741824 Sep 17 17:19:02 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:02 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb" returned: 0 in 0.387s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:02 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb Sep 17 17:19:02 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:02 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277 1073741824" returned: 0 in 0.420s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:02 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277 Sep 17 17:19:02 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:02 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d74ad519-5d45-4193-aef0-72eebcb034eb" returned: 0 in 0.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-d74ad519-5d45-4193-aef0-72eebcb034eb" released by "delete_volume" :: held 0.707s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created reservations ['6ee32323-9e29-45db-bf87-3d20562b2edb', 'de024790-0aa2-4c61-81bd-865c51454354', 'e0a65162-c223-4430-98e2-701b7c9c39b0', 'a48fc9ea-7f89-4077-b561-5a8c55835f35'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:03 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:03 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:03 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277" returned: 0 in 0.256s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4742560b-f426-4157-a246-4fb939246725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48095bf8-3ec5-4c22-a90f-facd50540277', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82bfa64-6cea-445d-849d-04b1eb9758db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:03 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Volume volume-48095bf8-3ec5-4c22-a90f-facd50540277 (48095bf8-3ec5-4c22-a90f-facd50540277): created successfully Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82bfa64-6cea-445d-849d-04b1eb9758db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Flow 'volume_create_manager' (465159a3-88ee-4ca0-93d5-c740243fdbfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:03 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-36533770-19a2-4a09-8b7d-4a6a6145582a tempest-CinderUnicodeTest-322582565 None] Created volume successfully. Sep 17 17:19:03 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.259s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:03 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Deleted volume successfully. Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-1d0528c6-715c-4009-ba12-79470a73ddd3-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-67eff8c9-07fe-4e86-b87f-1f4e072bffa5 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-d74ad519-5d45-4193-aef0-72eebcb034eb-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-1d0528c6-715c-4009-ba12-79470a73ddd3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-quobyte-1d0528c6-715c-4009-ba12-79470a73ddd3" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-1d0528c6-715c-4009-ba12-79470a73ddd3" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[505b5fbe-0317-41ce-9de0-784703dba7cd]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:03 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3 Sep 17 17:19:03 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:03 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3" returned: 0 in 0.374s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:03 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3 Sep 17 17:19:03 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Flow 'volume_create_manager' (2c9a3dfc-ffc0-48e7-b4f3-6c667a68654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c53740-17db-4817-81eb-96ff0dac25a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c53740-17db-4817-81eb-96ff0dac25a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1640571693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c96edb-27c7-4673-ae97-9b1e1ba5025d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ce3f16136c46a2a393193e57949c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:04Z,use_quota=True,user_id='f0bf655948d04dc692d8f5becf57e4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29bf502-0bef-4200-82b9-42023ba3a129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29bf502-0bef-4200-82b9-42023ba3a129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d54f6cb-a317-4074-b422-7e7ca6090ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d54f6cb-a317-4074-b422-7e7ca6090ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c96edb-27c7-4673-ae97-9b1e1ba5025d', 'volume_name': 'volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed0bfd2-2234-4e2b-b931-679061fc3ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed0bfd2-2234-4e2b-b931-679061fc3ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6eba32-2a67-4fc6-947f-d0d33b480158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:03 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Volume 14c96edb-27c7-4673-ae97-9b1e1ba5025d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d', 'volume_size': 1} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1640571693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c96edb-27c7-4673-ae97-9b1e1ba5025d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ce3f16136c46a2a393193e57949c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:04Z,use_quota=True,user_id='f0bf655948d04dc692d8f5becf57e4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Creating volume 14c96edb-27c7-4673-ae97-9b1e1ba5025d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:19:04 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:04 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d 1073741824 Sep 17 17:19:04 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:04 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-1d0528c6-715c-4009-ba12-79470a73ddd3" returned: 0 in 0.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-1d0528c6-715c-4009-ba12-79470a73ddd3" released by "delete_volume" :: held 0.683s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created reservations ['78fd4e98-8e79-4ebd-a1f2-6792743399d8', '3a699af6-fa54-4416-bf85-a37130615959', '12cf8608-1dd8-4c47-8616-bbadeed80cdc', '798d64af-28fc-498d-bf9e-275adf822729'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:04 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:04 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:04 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d 1073741824" returned: 0 in 0.454s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:04 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d Sep 17 17:19:04 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:04 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.286s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Deleted volume successfully. Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2c074295-5ee4-4af0-aaaf-14b780e29aa4 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-1d0528c6-715c-4009-ba12-79470a73ddd3-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-3f62df65-56d4-4725-87c7-98f9afe58895-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-3f62df65-56d4-4725-87c7-98f9afe58895-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-quobyte-3f62df65-56d4-4725-87c7-98f9afe58895" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-3f62df65-56d4-4725-87c7-98f9afe58895" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c672b4b6-5e8f-4f6d-b27a-d05f937f3325]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:04 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d" returned: 0 in 0.320s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:04 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895 Sep 17 17:19:04 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6eba32-2a67-4fc6-947f-d0d33b480158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f833f050-49a3-438b-9d88-ff357f0a436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:04 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Volume volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d (14c96edb-27c7-4673-ae97-9b1e1ba5025d): created successfully Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f833f050-49a3-438b-9d88-ff357f0a436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Flow 'volume_create_manager' (2c9a3dfc-ffc0-48e7-b4f3-6c667a68654e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7f0a47d8-e6f4-4456-9dbb-9e66da9cfe19 tempest-CinderUnicodeTest-322582565 None] Created volume successfully. Sep 17 17:19:05 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895" returned: 0 in 0.366s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:05 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895 Sep 17 17:19:05 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:05 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-3f62df65-56d4-4725-87c7-98f9afe58895" returned: 0 in 0.245s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-3f62df65-56d4-4725-87c7-98f9afe58895" released by "delete_volume" :: held 0.654s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created reservations ['a9390965-c414-4a0b-b328-093fd893e538', '6bb4fb5c-734a-40ed-bd23-efba7919a0da', 'c210c98f-9678-493d-a3dd-eae6db7d254f', '403b8ae6-8861-4ee9-8804-9a0a79316f36'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:05 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:05 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:05 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.244s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:05 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Deleted volume successfully. Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b2fd431-9733-48bc-8170-995034662415 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-3f62df65-56d4-4725-87c7-98f9afe58895-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-64447d6a-57bb-42ad-9b62-d1124dd8d1d1-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-64447d6a-57bb-42ad-9b62-d1124dd8d1d1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-quobyte-64447d6a-57bb-42ad-9b62-d1124dd8d1d1" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-64447d6a-57bb-42ad-9b62-d1124dd8d1d1" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9db485-f069-4c63-9982-8cd576277563]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:06 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1 Sep 17 17:19:06 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Creating offline snapshot 2b60081d-d409-4022-a590-24cb29bd2706 of volume 14c96edb-27c7-4673-ae97-9b1e1ba5025d {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[80421ea3-e005-4661-8786-6e254425efd8]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:06 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1" returned: 0 in 0.395s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:06 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1 Sep 17 17:19:06 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:06 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d Sep 17 17:19:06 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:06 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-64447d6a-57bb-42ad-9b62-d1124dd8d1d1" returned: 0 in 0.249s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-64447d6a-57bb-42ad-9b62-d1124dd8d1d1" released by "delete_volume" :: held 0.692s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created reservations ['df46f82e-5531-45c6-816a-7c74526ea593', '22870219-0530-49f9-a9b2-994c07e1ecf4', '6c838e9a-73ee-49c5-87b0-bc3abc3fc465', '7f92e2b9-d0d0-47ec-a040-0c40d33bfa50'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:06 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d" returned: 0 in 0.374s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:06 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 1G Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:06 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:06 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:06 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:06 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-5068f679-1f56-474c-9837-ea81be84cdb5-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:06 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Deleted volume successfully. Sep 17 17:19:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-5068f679-1f56-474c-9837-ea81be84cdb5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1ac461cb-44ae-41a5-a08a-a43679bf7b12 tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-64447d6a-57bb-42ad-9b62-d1124dd8d1d1-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "cinder-quobyte-5068f679-1f56-474c-9837-ea81be84cdb5" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-5068f679-1f56-474c-9837-ea81be84cdb5" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16f14dc-b9b0-4598-929d-381feef5da38]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:07 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 1G" returned: 0 in 0.457s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:07 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 Sep 17 17:19:07 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:07 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5 Sep 17 17:19:07 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:07 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706" returned: 0 in 0.289s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:07 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 is being set with open permissions: ugo+rw Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:07 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 Sep 17 17:19:07 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:07 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5" returned: 0 in 0.387s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:07 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5 Sep 17 17:19:07 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:07 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706" returned: 0 in 0.257s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:07 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:07 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.info Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5068f679-1f56-474c-9837-ea81be84cdb5" returned: 0 in 0.247s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:07 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-quobyte-5068f679-1f56-474c-9837-ea81be84cdb5" released by "delete_volume" :: held 0.678s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Created reservations ['484328bd-c80d-4d0e-9d25-1d19b2fd08c0', '6703de39-666a-4956-a3d5-6abec9e21370', '78f3a54e-34d6-4284-9dee-2ac1dd3a8964', '0caa03d5-2a37-4d1f-ae2a-f74fa2df7b07'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:07 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:07 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:07 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.info" returned: 0 in 0.284s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:07 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.info is being set with open permissions: ugo+rw Sep 17 17:19:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:08 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.info Sep 17 17:19:08 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:08 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.267s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:08 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:08 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Deleted volume successfully. Sep 17 17:19:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-8bf4da7f-b6d8-4911-b280-a012e859b17d tempest-CreateVolumesFromSourceVolumeTest-124979408 None] Lock "cinder-5068f679-1f56-474c-9837-ea81be84cdb5-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:08 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.info" returned: 0 in 0.252s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:08 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1b32f828-1b48-41cb-be5c-4f97006f8dc1 tempest-CinderUnicodeTest-322582565 None] Create snapshot completed successfully Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Acquiring lock "cinder-2b60081d-d409-4022-a590-24cb29bd2706-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Lock "cinder-2b60081d-d409-4022-a590-24cb29bd2706-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Acquiring lock "cinder-quobyte-14c96edb-27c7-4673-ae97-9b1e1ba5025d" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Lock "cinder-quobyte-14c96edb-27c7-4673-ae97-9b1e1ba5025d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Acquiring lock "cinder-quobyte-2b60081d-d409-4022-a590-24cb29bd2706" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Lock "cinder-quobyte-2b60081d-d409-4022-a590-24cb29bd2706" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Deleting offline snapshot 2b60081d-d409-4022-a590-24cb29bd2706 of volume 14c96edb-27c7-4673-ae97-9b1e1ba5025d {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] snapshot_file for this snap is: volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8598923e-c6a1-4456-9f1a-7a77f4b0a353]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:09 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 Sep 17 17:19:09 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:09 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706" returned: 0 in 0.387s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4efa459-1075-4e7a-819a-4e8082f5f436]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:10 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d Sep 17 17:19:10 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:10 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d" returned: 0 in 0.383s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:10 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 Sep 17 17:19:10 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:10 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706" returned: 0 in 0.334s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:10 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706 Sep 17 17:19:10 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:10 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d.2b60081d-d409-4022-a590-24cb29bd2706" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Lock "cinder-quobyte-2b60081d-d409-4022-a590-24cb29bd2706" released by "_delete_snapshot" :: held 1.486s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Lock "cinder-quobyte-14c96edb-27c7-4673-ae97-9b1e1ba5025d" released by "delete_snapshot" :: held 1.511s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:11 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Created reservations ['eac9618e-2f1e-418c-bbc1-a285cb5b6651', '743d6f6b-080a-49b2-ae93-302374d3fd5c', '591af1ff-8732-49f8-adbb-6dd881fc3b7b', '5aa74334-812f-4a78-8eb2-a7158a776614'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:11 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Delete snapshot completed successfully. Sep 17 17:19:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-18c12d4b-831d-4738-aece-e7c06b2b845b tempest-CinderUnicodeTest-322582565 None] Lock "cinder-2b60081d-d409-4022-a590-24cb29bd2706-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Acquiring lock "cinder-14c96edb-27c7-4673-ae97-9b1e1ba5025d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Lock "cinder-14c96edb-27c7-4673-ae97-9b1e1ba5025d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Acquiring lock "cinder-quobyte-14c96edb-27c7-4673-ae97-9b1e1ba5025d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Lock "cinder-quobyte-14c96edb-27c7-4673-ae97-9b1e1ba5025d" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:11 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a5b13c-0619-472e-bd6c-92f1077c1a91]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:11 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d Sep 17 17:19:11 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:12 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d" returned: 0 in 0.415s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:12 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d Sep 17 17:19:12 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:12 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-14c96edb-27c7-4673-ae97-9b1e1ba5025d" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Lock "cinder-quobyte-14c96edb-27c7-4673-ae97-9b1e1ba5025d" released by "delete_volume" :: held 0.761s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Created reservations ['e5f89644-9f38-48f3-bfcd-cb8fd7bea159', '59f2374c-587f-4bf0-a074-77b95fe4a46c', 'c04dd6df-bd8d-48f6-bd71-0395aa627d6d', '34f19936-e079-417c-8109-c86da0f5f022'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:12 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:12 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Acquiring lock "cinder-48095bf8-3ec5-4c22-a90f-facd50540277-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Lock "cinder-48095bf8-3ec5-4c22-a90f-facd50540277-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:12 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Acquiring lock "cinder-quobyte-48095bf8-3ec5-4c22-a90f-facd50540277" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.291s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:12 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Deleted volume successfully. Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Lock "cinder-quobyte-48095bf8-3ec5-4c22-a90f-facd50540277" acquired by "delete_volume" :: waited 0.040s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c72d162f-51e4-4ddf-9dea-bb38336ad4a3 tempest-CinderUnicodeTest-322582565 None] Lock "cinder-14c96edb-27c7-4673-ae97-9b1e1ba5025d-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f786065-1a5e-4d48-9b54-007b00f121ff]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:13 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277 Sep 17 17:19:13 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Flow 'volume_create_manager' (ca93768d-8310-4b59-8fbf-ff81e1b08081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa3837c-e932-4ddf-ab49-df2ef2cb7b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa3837c-e932-4ddf-ab49-df2ef2cb7b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d38647-c115-469f-8231-22a7bcfa2b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5619c40374cd78abde144cd6a985c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:13Z,use_quota=True,user_id='54bbc6b82a1d4612a52679c975661405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d07636a-6e59-446e-9ae0-a5e1fc620f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d07636a-6e59-446e-9ae0-a5e1fc620f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf69a21-7f28-486d-8aac-5aa1e603ca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.image.glance [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Creating Keystone auth plugin from conf {{(pid=85889) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 17:19:13 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277" returned: 0 in 0.401s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:13 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277 Sep 17 17:19:13 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf69a21-7f28-486d-8aac-5aa1e603ca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30d38647-c115-469f-8231-22a7bcfa2b78', 'volume_name': 'volume-30d38647-c115-469f-8231-22a7bcfa2b78', 'volume_size': 1, 'image_id': 'dea560fb-d6b6-4e85-abee-086ef56a93f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dea560fb-d6b6-4e85-abee-086ef56a93f9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0bf667cca5e89b1e0aa23ef173547c86', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b5619c40374cd78abde144cd6a985c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b1bfd14099e5e8d6f75a7db9142c0e8e18224a13b3cd2271f0135ca76933dcc35a23791f46fdb56a36c3625a0e87552d9eec7e552af9f8a068565a958150438', 'id': 'dea560fb-d6b6-4e85-abee-086ef56a93f9', 'created_at': datetime.datetime(2026, 9, 17, 15, 19, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 19, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dea560fb-d6b6-4e85-abee-086ef56a93f9/file', 'properties': {}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7191a1e9-70b8-465a-b08d-f36a95fb8cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7191a1e9-70b8-465a-b08d-f36a95fb8cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f491d6-c9e2-41b8-8d20-9a2d8ea2c9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:13 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Volume 30d38647-c115-469f-8231-22a7bcfa2b78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30d38647-c115-469f-8231-22a7bcfa2b78', 'volume_size': 1, 'image_id': 'dea560fb-d6b6-4e85-abee-086ef56a93f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dea560fb-d6b6-4e85-abee-086ef56a93f9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0bf667cca5e89b1e0aa23ef173547c86', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b5619c40374cd78abde144cd6a985c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b1bfd14099e5e8d6f75a7db9142c0e8e18224a13b3cd2271f0135ca76933dcc35a23791f46fdb56a36c3625a0e87552d9eec7e552af9f8a068565a958150438', 'id': 'dea560fb-d6b6-4e85-abee-086ef56a93f9', 'created_at': datetime.datetime(2026, 9, 17, 15, 19, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 19, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dea560fb-d6b6-4e85-abee-086ef56a93f9/file', 'properties': {}}, 'image_service': } Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Trying to clone 30d38647-c115-469f-8231-22a7bcfa2b78 from image dea560fb-d6b6-4e85-abee-086ef56a93f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dea560fb-d6b6-4e85-abee-086ef56a93f9', 'metadata': {}}]). {{(pid=85889) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 17:19:13 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-48095bf8-3ec5-4c22-a90f-facd50540277" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Lock "cinder-quobyte-48095bf8-3ec5-4c22-a90f-facd50540277" released by "delete_volume" :: held 0.718s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 17:19:13 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Image download 0.00 MB at 0.00 MB/s Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Created reservations ['544e1252-72ad-4f12-8af5-24796b0844fa', '06667a60-1196-4515-b513-72801b31c0bf', '4cb2a79b-d851-4841-ad28-1c439213aec7', 'f37e40d7-866a-47ca-9c2d-0f07139a2b29'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0109df5-199d-4811-b810-b5db2e69825c]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:13 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:13 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:13 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD Sep 17 17:19:13 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:13 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:13 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:14 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Deleted volume successfully. Sep 17 17:19:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-87413ca5-9f64-446c-b802-17ad00872be6 tempest-CinderUnicodeTest-322582565 None] Lock "cinder-48095bf8-3ec5-4c22-a90f-facd50540277-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:14 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:14 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD Sep 17 17:19:14 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:14 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:19:14 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Temporary image dea560fb-d6b6-4e85-abee-086ef56a93f9 is fetched for user 54bbc6b82a1d4612a52679c975661405. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 17:19:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7243fa4e-8819-4221-9183-4220b263db04]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:14 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD Sep 17 17:19:14 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:14 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:14 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD Sep 17 17:19:14 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:15 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d38647-c115-469f-8231-22a7bcfa2b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5619c40374cd78abde144cd6a985c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:13Z,use_quota=True,user_id='54bbc6b82a1d4612a52679c975661405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Creating volume 30d38647-c115-469f-8231-22a7bcfa2b78 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:19:15 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:15 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 1073741824 Sep 17 17:19:15 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:15 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 1073741824" returned: 0 in 0.440s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:15 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 Sep 17 17:19:15 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:15 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78" returned: 0 in 0.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Attempting download of dea560fb-d6b6-4e85-abee-086ef56a93f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/dea560fb-d6b6-4e85-abee-086ef56a93f9', 'metadata': {}}])) to volume 30d38647-c115-469f-8231-22a7bcfa2b78. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[445fa706-94e8-4794-846c-588ea0145c9b]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dea560fb-d6b6-4e85-abee-086ef56a93f9_gtw64hbd {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:16 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dea560fb-d6b6-4e85-abee-086ef56a93f9_gtw64hbd Sep 17 17:19:16 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:16 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dea560fb-d6b6-4e85-abee-086ef56a93f9_gtw64hbd" returned: 0 in 0.332s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dea560fb-d6b6-4e85-abee-086ef56a93f9_gtw64hbd {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:16 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dea560fb-d6b6-4e85-abee-086ef56a93f9_gtw64hbd Sep 17 17:19:16 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:16 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dea560fb-d6b6-4e85-abee-086ef56a93f9_gtw64hbd" returned: 1 in 0.321s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dea560fb-d6b6-4e85-abee-086ef56a93f9_gtw64hbd' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:19:16 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cb8649-5a89-40ab-84a9-34d151cbacfe]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:16 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD Sep 17 17:19:16 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:16 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:17 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD Sep 17 17:19:17 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:17 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:19:17 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] dea560fb-d6b6-4e85-abee-086ef56a93f9 was raw, converting to qcow2 {{(pid=85889) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 17:19:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:17 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 Sep 17 17:19:17 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:17 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78" returned: 0 in 0.501s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:17 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dea560fb-d6b6-4e85-abee-086ef56a93f9_nbm3ns9qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:19:17 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 17:19:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:17 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 1G Sep 17 17:19:17 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:18 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 1G" returned: 0 in 0.346s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Downloaded image dea560fb-d6b6-4e85-abee-086ef56a93f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/dea560fb-d6b6-4e85-abee-086ef56a93f9', 'metadata': {}}])) to volume 30d38647-c115-469f-8231-22a7bcfa2b78 successfully. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Temporary image dea560fb-d6b6-4e85-abee-086ef56a93f9 for user 54bbc6b82a1d4612a52679c975661405 is deleted. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Marking volume 30d38647-c115-469f-8231-22a7bcfa2b78 as bootable. {{(pid=85889) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Copying metadata from image dea560fb-d6b6-4e85-abee-086ef56a93f9 to 30d38647-c115-469f-8231-22a7bcfa2b78. {{(pid=85889) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Creating volume glance metadata for volume 30d38647-c115-469f-8231-22a7bcfa2b78 backed by image dea560fb-d6b6-4e85-abee-086ef56a93f9 with: {'image_id': 'dea560fb-d6b6-4e85-abee-086ef56a93f9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0bf667cca5e89b1e0aa23ef173547c86', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85889) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f491d6-c9e2-41b8-8d20-9a2d8ea2c9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d38647-c115-469f-8231-22a7bcfa2b78', 'volume_size': 1, 'image_id': 'dea560fb-d6b6-4e85-abee-086ef56a93f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dea560fb-d6b6-4e85-abee-086ef56a93f9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0bf667cca5e89b1e0aa23ef173547c86', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b5619c40374cd78abde144cd6a985c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b1bfd14099e5e8d6f75a7db9142c0e8e18224a13b3cd2271f0135ca76933dcc35a23791f46fdb56a36c3625a0e87552d9eec7e552af9f8a068565a958150438', 'id': 'dea560fb-d6b6-4e85-abee-086ef56a93f9', 'created_at': datetime.datetime(2026, 9, 17, 15, 19, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 19, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dea560fb-d6b6-4e85-abee-086ef56a93f9/file', 'properties': {}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38af2cc-f768-4904-babb-02bea03936d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:18 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Volume volume-30d38647-c115-469f-8231-22a7bcfa2b78 (30d38647-c115-469f-8231-22a7bcfa2b78): created successfully Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38af2cc-f768-4904-babb-02bea03936d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Flow 'volume_create_manager' (ca93768d-8310-4b59-8fbf-ff81e1b08081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:18 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-96a69441-2cd4-4b77-84c8-ce97735830a3 tempest-VolumeImageDependencyTests-14920847 None] Created volume successfully. Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Acquiring lock "cinder-30d38647-c115-469f-8231-22a7bcfa2b78-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Lock "cinder-30d38647-c115-469f-8231-22a7bcfa2b78-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Acquiring lock "cinder-quobyte-30d38647-c115-469f-8231-22a7bcfa2b78" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Lock "cinder-quobyte-30d38647-c115-469f-8231-22a7bcfa2b78" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbc2fa8-8d83-4b48-81bc-39a09c76a251]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:18 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 Sep 17 17:19:18 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:19 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78" returned: 0 in 0.380s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:19 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78 Sep 17 17:19:19 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:19 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-30d38647-c115-469f-8231-22a7bcfa2b78" returned: 0 in 0.255s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Lock "cinder-quobyte-30d38647-c115-469f-8231-22a7bcfa2b78" released by "delete_volume" :: held 0.681s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Created reservations ['b0235891-5183-40bd-a8e6-210ecaf3ee3a', 'c5c643dd-e409-4bd1-b96b-5e4f3c53000c', 'c64752b2-1e05-4c5f-894d-c0d8bcc94341', '791e7af3-e6ee-476b-9cf4-ed6a8554094e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:19 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:19 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:19 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.279s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Deleted volume successfully. Sep 17 17:19:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-33257791-a3de-49de-bf88-92e78123f316 tempest-VolumeImageDependencyTests-14920847 None] Lock "cinder-30d38647-c115-469f-8231-22a7bcfa2b78-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Flow 'volume_create_manager' (19285446-ec10-416a-966c-7f1de0bd0e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cac08f-4785-4052-a3f4-be500f086f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cac08f-4785-4052-a3f4-be500f086f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784411152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc15994b-7350-46e1-b924-abb017d3a7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f31c3368d747a69e37fba672fd2950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:22Z,use_quota=True,user_id='a3a56845e07940fe819b56d102ddb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4844bf58-28b6-40f6-9686-152cfe47b0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4844bf58-28b6-40f6-9686-152cfe47b0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a9c7e5-adfd-46e4-a4f8-4a33d07e9e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a9c7e5-adfd-46e4-a4f8-4a33d07e9e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc15994b-7350-46e1-b924-abb017d3a7df', 'volume_name': 'volume-dc15994b-7350-46e1-b924-abb017d3a7df', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea2d49d-45e8-4b42-923e-1d6ba11989d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea2d49d-45e8-4b42-923e-1d6ba11989d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098ef4d3-3e00-46e2-aecd-d276082db8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:22 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Volume dc15994b-7350-46e1-b924-abb017d3a7df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc15994b-7350-46e1-b924-abb017d3a7df', 'volume_size': 1} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784411152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc15994b-7350-46e1-b924-abb017d3a7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f31c3368d747a69e37fba672fd2950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:22Z,use_quota=True,user_id='a3a56845e07940fe819b56d102ddb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Creating volume dc15994b-7350-46e1-b924-abb017d3a7df {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:19:22 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:22 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df 1073741824 Sep 17 17:19:22 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:22 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:22 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:22 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:19:22 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df 1073741824" returned: 0 in 0.414s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:22 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df Sep 17 17:19:22 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:22 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df" returned: 0 in 0.242s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098ef4d3-3e00-46e2-aecd-d276082db8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc15994b-7350-46e1-b924-abb017d3a7df', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e78f56-11c4-4fe7-b865-3d282796f9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:22 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Volume volume-dc15994b-7350-46e1-b924-abb017d3a7df (dc15994b-7350-46e1-b924-abb017d3a7df): created successfully Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e78f56-11c4-4fe7-b865-3d282796f9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Flow 'volume_create_manager' (19285446-ec10-416a-966c-7f1de0bd0e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:22 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d8a533f7-9967-48eb-abb9-37322aef7604 tempest-ProjectReaderTests-1701342637 None] Created volume successfully. Sep 17 17:19:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "cinder-dc15994b-7350-46e1-b924-abb017d3a7df-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-dc15994b-7350-46e1-b924-abb017d3a7df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "cinder-quobyte-dc15994b-7350-46e1-b924-abb017d3a7df" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-quobyte-dc15994b-7350-46e1-b924-abb017d3a7df" acquired by "delete_volume" :: waited 0.013s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:23 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[222588fa-8464-44e9-a91a-b92283377304]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:23 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df Sep 17 17:19:23 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:23 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df" returned: 0 in 0.344s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:23 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df Sep 17 17:19:23 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:23 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dc15994b-7350-46e1-b924-abb017d3a7df" returned: 0 in 0.243s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-quobyte-dc15994b-7350-46e1-b924-abb017d3a7df" released by "delete_volume" :: held 0.626s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Created reservations ['2ce79a6d-27a6-4778-8c6f-5b00e7b32cd8', 'e158c162-f247-4e1e-bdec-faf023ae114e', 'd2486d50-8eff-41ab-a043-8f95a8b41c4b', 'ac06e47b-0ca3-483b-9f8d-c96cefd4024d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:24 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:24 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:24 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.248s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:24 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Deleted volume successfully. Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cfca0d94-c79d-4501-a656-5ddacf1df8b7 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-dc15994b-7350-46e1-b924-abb017d3a7df-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Flow 'volume_create_manager' (7aaadb72-4bb4-4dd9-bb7b-60965fb6fc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b58892-312f-4d96-bc0b-de033508d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b58892-312f-4d96-bc0b-de033508d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198055751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c997a473-c67d-4009-9eab-6363f138e809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f31c3368d747a69e37fba672fd2950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:25Z,use_quota=True,user_id='a3a56845e07940fe819b56d102ddb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458ccdab-5312-4222-9ea1-4f784f49056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458ccdab-5312-4222-9ea1-4f784f49056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d5af30-77f7-412b-92a6-ed10d59e8463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d5af30-77f7-412b-92a6-ed10d59e8463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c997a473-c67d-4009-9eab-6363f138e809', 'volume_name': 'volume-c997a473-c67d-4009-9eab-6363f138e809', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e42ca0-99a4-4efa-a1a6-1e3a4f831046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e42ca0-99a4-4efa-a1a6-1e3a4f831046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090bc098-b491-4aca-80fb-3a95fde08bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:24 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Volume c997a473-c67d-4009-9eab-6363f138e809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c997a473-c67d-4009-9eab-6363f138e809', 'volume_size': 1} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198055751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c997a473-c67d-4009-9eab-6363f138e809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f31c3368d747a69e37fba672fd2950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:25Z,use_quota=True,user_id='a3a56845e07940fe819b56d102ddb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Creating volume c997a473-c67d-4009-9eab-6363f138e809 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:19:24 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:19:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:24 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809 1073741824 Sep 17 17:19:24 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:25 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809 1073741824" returned: 0 in 0.406s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:25 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809 Sep 17 17:19:25 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:25 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809" returned: 0 in 0.238s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090bc098-b491-4aca-80fb-3a95fde08bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c997a473-c67d-4009-9eab-6363f138e809', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d75f08-13e9-45d4-9a54-deb711dde9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:25 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Volume volume-c997a473-c67d-4009-9eab-6363f138e809 (c997a473-c67d-4009-9eab-6363f138e809): created successfully Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d75f08-13e9-45d4-9a54-deb711dde9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Flow 'volume_create_manager' (7aaadb72-4bb4-4dd9-bb7b-60965fb6fc26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:25 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-15cbea26-8fcf-431a-a7ab-fe168b93a536 tempest-ProjectReaderTests-1701342637 None] Created volume successfully. Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Acquiring lock "cinder-c997a473-c67d-4009-9eab-6363f138e809-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Lock "cinder-c997a473-c67d-4009-9eab-6363f138e809-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Acquiring lock "cinder-quobyte-c997a473-c67d-4009-9eab-6363f138e809" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:25 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Lock "cinder-quobyte-c997a473-c67d-4009-9eab-6363f138e809" acquired by "delete_volume" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2657757-8a58-4adf-b07f-602c3cd57dff]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:26 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809 Sep 17 17:19:26 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:26 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809" returned: 0 in 0.358s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:26 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809 Sep 17 17:19:26 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:26 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c997a473-c67d-4009-9eab-6363f138e809" returned: 0 in 0.249s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Lock "cinder-quobyte-c997a473-c67d-4009-9eab-6363f138e809" released by "delete_volume" :: held 0.657s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Created reservations ['b7915df5-9eeb-4fa2-9888-69258ec98648', 'c2d8adfa-3563-4864-bdd2-948df517d34a', '30e493a1-0e0d-44b9-98a7-76dff428866c', '7ecf05be-4360-44eb-81b5-705c3d3844d3'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:26 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:26 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:26 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.248s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:27 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Deleted volume successfully. Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-19df3c33-7735-48d1-88c4-cbb13082b9ba tempest-ProjectReaderTests-1701342637 None] Lock "cinder-c997a473-c67d-4009-9eab-6363f138e809-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Flow 'volume_create_manager' (d0487f46-9b64-4de1-be33-6626f303ac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b83205-c9b7-4878-ae16-539bf259c645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b83205-c9b7-4878-ae16-539bf259c645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110183854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9810e16-009f-4d3c-aabf-52c974d85cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f31c3368d747a69e37fba672fd2950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:27Z,use_quota=True,user_id='a3a56845e07940fe819b56d102ddb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd57eaa-30d5-4c55-9f63-aa275bdd1180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd57eaa-30d5-4c55-9f63-aa275bdd1180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9d4e61-e8c3-491d-8033-516f0193efae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9d4e61-e8c3-491d-8033-516f0193efae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9810e16-009f-4d3c-aabf-52c974d85cbe', 'volume_name': 'volume-f9810e16-009f-4d3c-aabf-52c974d85cbe', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f905e87b-a191-4500-8ecd-dcdd62c375f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f905e87b-a191-4500-8ecd-dcdd62c375f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804f7142-4f28-4a40-a300-194e03cca60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:27 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Volume f9810e16-009f-4d3c-aabf-52c974d85cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9810e16-009f-4d3c-aabf-52c974d85cbe', 'volume_size': 1} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110183854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9810e16-009f-4d3c-aabf-52c974d85cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f31c3368d747a69e37fba672fd2950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:27Z,use_quota=True,user_id='a3a56845e07940fe819b56d102ddb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Creating volume f9810e16-009f-4d3c-aabf-52c974d85cbe {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:19:27 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:27 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe 1073741824 Sep 17 17:19:27 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:27 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe 1073741824" returned: 0 in 0.412s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:28 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe Sep 17 17:19:28 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:28 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe" returned: 0 in 0.237s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804f7142-4f28-4a40-a300-194e03cca60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9810e16-009f-4d3c-aabf-52c974d85cbe', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7883236d-5c52-46a3-9aa3-6303711766c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:28 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Volume volume-f9810e16-009f-4d3c-aabf-52c974d85cbe (f9810e16-009f-4d3c-aabf-52c974d85cbe): created successfully Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7883236d-5c52-46a3-9aa3-6303711766c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Flow 'volume_create_manager' (d0487f46-9b64-4de1-be33-6626f303ac06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:28 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-047ec799-ccfb-4db2-b1c2-880a2a96e04d tempest-ProjectReaderTests-1701342637 None] Created volume successfully. Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "cinder-f9810e16-009f-4d3c-aabf-52c974d85cbe-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-f9810e16-009f-4d3c-aabf-52c974d85cbe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "cinder-quobyte-f9810e16-009f-4d3c-aabf-52c974d85cbe" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-quobyte-f9810e16-009f-4d3c-aabf-52c974d85cbe" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c52c62-d836-4e1c-afde-cb320657fd4e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:28 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe Sep 17 17:19:28 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:28 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe" returned: 0 in 0.356s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:29 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe Sep 17 17:19:29 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:29 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f9810e16-009f-4d3c-aabf-52c974d85cbe" returned: 0 in 0.245s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-quobyte-f9810e16-009f-4d3c-aabf-52c974d85cbe" released by "delete_volume" :: held 0.640s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Created reservations ['f4aa63c3-63dd-4150-8436-5be5763b2d8e', 'e2e883d0-5533-4856-9f3b-c58c6786ceac', '901e5fe1-06fb-4c41-b37f-93955b83c284', '51a56f1e-f8e9-4615-ba2e-8cf04f56f812'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:29 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:29 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:29 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.245s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:29 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Deleted volume successfully. Sep 17 17:19:29 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-0869506e-0fa3-49e0-bda2-f24e7ae07042 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-f9810e16-009f-4d3c-aabf-52c974d85cbe-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Flow 'volume_create_manager' (40aa6940-3f3d-4e8e-9a7b-d650df5c0a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a60d849-27dd-467e-b597-09b818adf0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a60d849-27dd-467e-b597-09b818adf0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028635569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f31c3368d747a69e37fba672fd2950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:30Z,use_quota=True,user_id='a3a56845e07940fe819b56d102ddb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38767aeb-e05b-414b-8a16-fd441a59c897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38767aeb-e05b-414b-8a16-fd441a59c897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb194ac6-a2d4-45ef-888d-f499e15254cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb194ac6-a2d4-45ef-888d-f499e15254cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81', 'volume_name': 'volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12613c2-7ffa-4f6a-951d-34cf0579e183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12613c2-7ffa-4f6a-951d-34cf0579e183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ab435d-d66e-4301-8e29-e6c6164ab502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Volume aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81', 'volume_size': 1} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028635569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f31c3368d747a69e37fba672fd2950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:30Z,use_quota=True,user_id='a3a56845e07940fe819b56d102ddb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Creating volume aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:19:30 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:30 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 1073741824 Sep 17 17:19:30 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:30 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 1073741824" returned: 0 in 0.418s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:30 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 Sep 17 17:19:30 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:30 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81" returned: 0 in 0.250s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ab435d-d66e-4301-8e29-e6c6164ab502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fa9430-f5ff-464d-b0c0-ca1abf889090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Volume volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 (aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81): created successfully Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fa9430-f5ff-464d-b0c0-ca1abf889090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Flow 'volume_create_manager' (40aa6940-3f3d-4e8e-9a7b-d650df5c0a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c08b8dc4-5194-469f-b4d8-1a6902c5e1cf tempest-ProjectReaderTests-1701342637 None] Created volume successfully. Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "cinder-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "cinder-quobyte-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-quobyte-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4870917b-f994-4642-a121-75eda10cacca]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:31 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 Sep 17 17:19:31 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:31 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81" returned: 0 in 0.350s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:31 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81 Sep 17 17:19:31 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:31 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81" returned: 0 in 0.253s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-quobyte-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81" released by "delete_volume" :: held 0.647s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Created reservations ['4f650c78-fd3d-4f7e-a162-fafd1dfb337a', 'f9174248-78c6-43b2-ae9b-a5709a09ac5b', '47e24fd5-f1a6-42ed-8532-ecc227e8a447', 'd6098436-2d00-4e51-bce9-020b22cbb46f'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:32 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:19:32 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:32 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.249s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:32 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:19:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Deleted volume successfully. Sep 17 17:19:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-bac65089-d10f-400b-b3ee-474655b838d3 tempest-ProjectReaderTests-1701342637 None] Lock "cinder-aa3a3e4e-6c90-4b6f-b1ba-8ae1e9d55a81-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:19:41 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=115,cinder:UPDATE=174,cinder:INSERT=49,cinder:DELETE=14 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:19:42 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=120,cinder:INSERT=38,cinder:UPDATE=163,cinder:DELETE=15 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Flow 'volume_create_manager' (3a6fe4cc-4100-405a-9979-6f234e201963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df78493f-6550-4bcd-a352-9e87dd71605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df78493f-6550-4bcd-a352-9e87dd71605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1180278163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbfeaae-d625-4d08-9985-6e0526fbb0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517f52ff168444fea8891a5c157c8fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:54Z,use_quota=True,user_id='7b31c59a2ed6467989925b07c33039f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafedd17-a1c9-4fdf-be8f-1d1dd3666581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafedd17-a1c9-4fdf-be8f-1d1dd3666581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303eff00-2d5a-4c4b-bea5-a688797456a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303eff00-2d5a-4c4b-bea5-a688797456a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cbfeaae-d625-4d08-9985-6e0526fbb0ed', 'volume_name': 'volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956f1a0d-3102-42c5-bfe8-9297fcbc004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956f1a0d-3102-42c5-bfe8-9297fcbc004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dc90cb-5e11-4845-ab7d-e1244bc440d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:53 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Volume 0cbfeaae-d625-4d08-9985-6e0526fbb0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed', 'volume_size': 1} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1180278163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbfeaae-d625-4d08-9985-6e0526fbb0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517f52ff168444fea8891a5c157c8fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:54Z,use_quota=True,user_id='7b31c59a2ed6467989925b07c33039f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Creating volume 0cbfeaae-d625-4d08-9985-6e0526fbb0ed {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:19:53 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:19:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:53 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed 1073741824 Sep 17 17:19:53 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:54 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed 1073741824" returned: 0 in 0.409s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:54 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed Sep 17 17:19:54 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:54 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" returned: 0 in 0.245s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dc90cb-5e11-4845-ab7d-e1244bc440d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ad87d0-dc53-449a-b477-8671d2fec26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:54 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Volume volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed (0cbfeaae-d625-4d08-9985-6e0526fbb0ed): created successfully Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ad87d0-dc53-449a-b477-8671d2fec26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Flow 'volume_create_manager' (3a6fe4cc-4100-405a-9979-6f234e201963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ec6624cf-922e-4a09-94ed-47730c2d341a tempest-SnapshotDependencyTests-2099882854 None] Created volume successfully. Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Creating offline snapshot 97207bcb-b335-4ced-ad5f-5eddb5680b37 of volume 0cbfeaae-d625-4d08-9985-6e0526fbb0ed {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aefc96-73d6-4895-a141-289f96120a6e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:54 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed Sep 17 17:19:54 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:55 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:55 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 1G Sep 17 17:19:55 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:55 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 1G" returned: 0 in 0.377s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:55 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 Sep 17 17:19:55 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:55 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37" returned: 0 in 0.282s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:55 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 is being set with open permissions: ugo+rw Sep 17 17:19:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:55 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 Sep 17 17:19:55 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:56 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37" returned: 0 in 0.242s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:56 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.info Sep 17 17:19:56 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:56 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.info" returned: 0 in 0.247s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:56 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.info is being set with open permissions: ugo+rw Sep 17 17:19:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:56 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.info Sep 17 17:19:56 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:56 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.info" returned: 0 in 0.239s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b7b44261-be74-4863-9d73-413dd2d8a841 tempest-SnapshotDependencyTests-2099882854 None] Create snapshot completed successfully Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Flow 'volume_create_manager' (8a77ce62-5cbd-4462-ac69-d3deeec36d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a6fe5f-aaea-463b-aead-b56db1ad3a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a6fe5f-aaea-463b-aead-b56db1ad3a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a14469b-bdf0-440b-8ae0-2de1c455221f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517f52ff168444fea8891a5c157c8fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97207bcb-b335-4ced-ad5f-5eddb5680b37,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:19:57Z,use_quota=True,user_id='7b31c59a2ed6467989925b07c33039f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d2b6af-27b7-4927-a41e-3276db955cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d2b6af-27b7-4927-a41e-3276db955cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f02f11c-4fb0-47e0-8d91-d8e0f0cefc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f02f11c-4fb0-47e0-8d91-d8e0f0cefc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a14469b-bdf0-440b-8ae0-2de1c455221f', 'volume_name': 'volume-2a14469b-bdf0-440b-8ae0-2de1c455221f', 'volume_size': 1, 'snapshot_id': '97207bcb-b335-4ced-ad5f-5eddb5680b37'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f15d87-180a-4aa8-b347-cde498d1f7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f15d87-180a-4aa8-b347-cde498d1f7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce4dcb0-9fe2-4da3-846c-8d0ce61ceaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:19:57 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Volume 2a14469b-bdf0-440b-8ae0-2de1c455221f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a14469b-bdf0-440b-8ae0-2de1c455221f', 'volume_size': 1, 'snapshot_id': '97207bcb-b335-4ced-ad5f-5eddb5680b37'} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "cinder-quobyte-97207bcb-b335-4ced-ad5f-5eddb5680b37-2a14469b-bdf0-440b-8ae0-2de1c455221f" by "_create_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-97207bcb-b335-4ced-ad5f-5eddb5680b37-2a14469b-bdf0-440b-8ae0-2de1c455221f" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Creating volume 2a14469b-bdf0-440b-8ae0-2de1c455221f from snapshot 97207bcb-b335-4ced-ad5f-5eddb5680b37 {{(pid=85889) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "cinder-quobyte-2a14469b-bdf0-440b-8ae0-2de1c455221f" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-2a14469b-bdf0-440b-8ae0-2de1c455221f" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] snapshot: 97207bcb-b335-4ced-ad5f-5eddb5680b37, volume: 2a14469b-bdf0-440b-8ae0-2de1c455221f, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[239bac77-4f8f-438e-a8fc-0ea30eaee071]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:57 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 Sep 17 17:19:57 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:57 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37" returned: 0 in 0.356s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21427f2-b67a-49b1-ae62-ec0c4f9b83af]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:19:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:58 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed Sep 17 17:19:58 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:19:58 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Sep 17 17:19:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" returned: 0 in 0.356s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:19:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:19:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:19:58 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:19:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:19:58 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f Sep 17 17:19:58 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:04 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f" returned: 0 in 5.859s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:20:04 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Converted 1024.00 MB image at 174.75 MB/s Sep 17 17:20:04 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f is being set with open permissions: ugo+rw Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:04 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f Sep 17 17:20:04 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:04 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f" returned: 0 in 0.240s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-2a14469b-bdf0-440b-8ae0-2de1c455221f" released by "_copy_volume_from_snapshot" :: held 6.889s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-97207bcb-b335-4ced-ad5f-5eddb5680b37-2a14469b-bdf0-440b-8ae0-2de1c455221f" released by "_create_volume_from_snapshot" :: held 6.946s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.961s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce4dcb0-9fe2-4da3-846c-8d0ce61ceaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a14469b-bdf0-440b-8ae0-2de1c455221f', 'volume_size': 1, 'snapshot_id': '97207bcb-b335-4ced-ad5f-5eddb5680b37'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c0aee1-556d-4d22-a6b7-1fbd76600155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:04 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Volume volume-2a14469b-bdf0-440b-8ae0-2de1c455221f (2a14469b-bdf0-440b-8ae0-2de1c455221f): created successfully Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c0aee1-556d-4d22-a6b7-1fbd76600155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Flow 'volume_create_manager' (8a77ce62-5cbd-4462-ac69-d3deeec36d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-002ee0b0-b9bb-428d-a90c-dde6b634a0a7 tempest-SnapshotDependencyTests-2099882854 None] Created volume successfully. Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "cinder-97207bcb-b335-4ced-ad5f-5eddb5680b37-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-97207bcb-b335-4ced-ad5f-5eddb5680b37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "cinder-quobyte-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "cinder-quobyte-97207bcb-b335-4ced-ad5f-5eddb5680b37" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-97207bcb-b335-4ced-ad5f-5eddb5680b37" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Deleting offline snapshot 97207bcb-b335-4ced-ad5f-5eddb5680b37 of volume 0cbfeaae-d625-4d08-9985-6e0526fbb0ed {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] snapshot_file for this snap is: volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48388cd-9628-4f21-aa12-4194757dd40e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:05 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 Sep 17 17:20:05 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:05 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37" returned: 0 in 0.351s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7708382-371d-4eb6-9497-4209f858da06]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:05 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed Sep 17 17:20:05 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:06 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" returned: 0 in 0.537s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:06 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 Sep 17 17:20:06 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:06 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37" returned: 0 in 0.318s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:06 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37 Sep 17 17:20:06 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:06 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed.97207bcb-b335-4ced-ad5f-5eddb5680b37" returned: 0 in 0.239s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-97207bcb-b335-4ced-ad5f-5eddb5680b37" released by "_delete_snapshot" :: held 1.545s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" released by "delete_snapshot" :: held 1.565s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:06 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Created reservations ['1654e02f-7072-4bb1-9549-a7a7f12d824d', '10b00171-16f8-4563-b097-d14ed9d6aa85', '6ccff8b4-e991-49fd-ae39-18620700c145', '556d64fa-6935-4032-a41b-7a64c52d3800'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:06 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Delete snapshot completed successfully. Sep 17 17:20:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-099f5677-0984-45ac-ac2b-8a03efd23ae6 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-97207bcb-b335-4ced-ad5f-5eddb5680b37-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "cinder-0cbfeaae-d625-4d08-9985-6e0526fbb0ed-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-0cbfeaae-d625-4d08-9985-6e0526fbb0ed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "cinder-quobyte-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aeff6c-e778-4157-999a-5ee278182bb1]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:07 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed Sep 17 17:20:07 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:07 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" returned: 0 in 0.354s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:07 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed Sep 17 17:20:07 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:07 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" returned: 0 in 0.237s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-0cbfeaae-d625-4d08-9985-6e0526fbb0ed" released by "delete_volume" :: held 0.651s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:07 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Created reservations ['ac911096-a6e8-4120-8aba-69877f0af2af', '06bccc28-23f2-4b53-9f1a-db4eadc29817', '0db593a8-7d86-4fb2-96d3-a32f7bc28538', 'd345e6a9-45e5-4d8b-9d83-2db15681598b'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:08 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:08 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:08 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.238s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:08 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Deleted volume successfully. Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-31374419-c684-446d-9541-f0acedc98a09 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-0cbfeaae-d625-4d08-9985-6e0526fbb0ed-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "cinder-2a14469b-bdf0-440b-8ae0-2de1c455221f-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-2a14469b-bdf0-440b-8ae0-2de1c455221f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "cinder-quobyte-2a14469b-bdf0-440b-8ae0-2de1c455221f" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-2a14469b-bdf0-440b-8ae0-2de1c455221f" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1506289a-77d7-4607-9ddc-7412aaf9213d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:08 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f Sep 17 17:20:08 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:08 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:08 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f Sep 17 17:20:08 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:09 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2a14469b-bdf0-440b-8ae0-2de1c455221f" returned: 0 in 0.245s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-quobyte-2a14469b-bdf0-440b-8ae0-2de1c455221f" released by "delete_volume" :: held 0.646s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Created reservations ['682cde9e-2d37-419e-93f3-bc1e8a249cc5', 'bec7af47-3881-4e7e-8242-e6c1a92885fa', '7540c23e-4b3d-47f9-ae79-aac298385748', 'cf910bfc-d263-4737-b930-6b1d4aec1446'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:09 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:09 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:09 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.246s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Deleted volume successfully. Sep 17 17:20:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8ab120f-7855-4e48-b063-74bc269ae4d6 tempest-SnapshotDependencyTests-2099882854 None] Lock "cinder-2a14469b-bdf0-440b-8ae0-2de1c455221f-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:19 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=20,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=1 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:20:19 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=29,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=7 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:22 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:22 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:22 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.244s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:20:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (d5b43da3-b5a6-4ea7-b157-7ab18c67ccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9d053f-ff6a-4639-aa5b-deae77c72045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9d053f-ff6a-4639-aa5b-deae77c72045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093485843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48c2e3a-d889-4bf8-b547-be7304255fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:29Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e559066-cf80-4460-8fb3-e92ac731b133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e559066-cf80-4460-8fb3-e92ac731b133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5a602d-bab9-41bd-8774-38321f371381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5a602d-bab9-41bd-8774-38321f371381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48c2e3a-d889-4bf8-b547-be7304255fbb', 'volume_name': 'volume-b48c2e3a-d889-4bf8-b547-be7304255fbb', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb0d7d3-7077-43db-a5e2-43d5df2bfe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb0d7d3-7077-43db-a5e2-43d5df2bfe28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ea819a-9372-41a6-897b-493d24ed07a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:29 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume b48c2e3a-d889-4bf8-b547-be7304255fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48c2e3a-d889-4bf8-b547-be7304255fbb', 'volume_size': 1} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093485843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48c2e3a-d889-4bf8-b547-be7304255fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:29Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Creating volume b48c2e3a-d889-4bf8-b547-be7304255fbb {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:29 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:29 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb 1073741824 Sep 17 17:20:29 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Flow 'volume_create_manager' (6e38c4c5-e6da-453a-b9d4-4466e28ea97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7443db-e752-462d-b4bc-21a6b15c4bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7443db-e752-462d-b4bc-21a6b15c4bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1476532765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905ab239-eabf-4206-be96-d8c8345b831d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9920b7a66329490b8bdec59fc9b1e463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:30Z,use_quota=True,user_id='7c5b1341609345489a32831bbafb5cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc417810-cefa-41bc-96f4-2e17c64e5355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc417810-cefa-41bc-96f4-2e17c64e5355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5de153a-ba47-49e8-b834-d10a332f82be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5de153a-ba47-49e8-b834-d10a332f82be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905ab239-eabf-4206-be96-d8c8345b831d', 'volume_name': 'volume-905ab239-eabf-4206-be96-d8c8345b831d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b921d145-5879-43ec-bd66-c301e8ef215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b921d145-5879-43ec-bd66-c301e8ef215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222eb4f4-b320-45ff-a3c7-6a7a16903113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:29 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Volume 905ab239-eabf-4206-be96-d8c8345b831d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905ab239-eabf-4206-be96-d8c8345b831d', 'volume_size': 1} Sep 17 17:20:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Flow 'volume_create_manager' (37c2ce26-6520-4a5c-8796-f9d160125100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b276a6-70a5-429f-b166-620d441d17c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b276a6-70a5-429f-b166-620d441d17c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-607944631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa5bf4a-a149-43de-b866-77d5b26c9b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279172a4da9d45f1bfa44089f7f32438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:30Z,use_quota=True,user_id='17c0c33133134d4c8ab2bae0a41043a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6991917-8d62-4350-af8b-30370824f45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6991917-8d62-4350-af8b-30370824f45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c39df7-a7e0-4ee1-b573-ef58983394d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c39df7-a7e0-4ee1-b573-ef58983394d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa5bf4a-a149-43de-b866-77d5b26c9b33', 'volume_name': 'volume-daa5bf4a-a149-43de-b866-77d5b26c9b33', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a37228-3662-479e-b7a1-ba30f5500464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a37228-3662-479e-b7a1-ba30f5500464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db126598-4f06-4909-9f0c-aae5e34c3786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Volume daa5bf4a-a149-43de-b866-77d5b26c9b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa5bf4a-a149-43de-b866-77d5b26c9b33', 'volume_size': 1} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:30 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb 1073741824" returned: 0 in 0.553s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:30 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb Sep 17 17:20:30 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:30 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb" returned: 0 in 0.307s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1476532765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905ab239-eabf-4206-be96-d8c8345b831d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9920b7a66329490b8bdec59fc9b1e463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:30Z,use_quota=True,user_id='7c5b1341609345489a32831bbafb5cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Creating volume 905ab239-eabf-4206-be96-d8c8345b831d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:30 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ea819a-9372-41a6-897b-493d24ed07a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48c2e3a-d889-4bf8-b547-be7304255fbb', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:30 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d 1073741824 Sep 17 17:20:30 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03c155c-a4e1-480a-b8c1-d41633fe1aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume volume-b48c2e3a-d889-4bf8-b547-be7304255fbb (b48c2e3a-d889-4bf8-b547-be7304255fbb): created successfully Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03c155c-a4e1-480a-b8c1-d41633fe1aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (d5b43da3-b5a6-4ea7-b157-7ab18c67ccd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5352e5d7-b405-4a45-bddf-e7aea7a4cae4 tempest-CreateVolumesFromSnapshotTest-183439184 None] Created volume successfully. Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Flow 'volume_create_manager' (5c86a996-2ab7-424c-9211-2f439cbfb059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d905d8c-bb7a-40a2-bd1f-71c011303923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d905d8c-bb7a-40a2-bd1f-71c011303923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-889679971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01622154-50ff-4f52-9fdd-e596b3c7e12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279172a4da9d45f1bfa44089f7f32438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:31Z,use_quota=True,user_id='17c0c33133134d4c8ab2bae0a41043a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514a4899-b028-44c6-9604-f3a2871c54e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514a4899-b028-44c6-9604-f3a2871c54e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee3908d-b9b2-4559-81ad-2517253d4e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee3908d-b9b2-4559-81ad-2517253d4e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01622154-50ff-4f52-9fdd-e596b3c7e12f', 'volume_name': 'volume-01622154-50ff-4f52-9fdd-e596b3c7e12f', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4ff019-cff5-4b00-a937-9aca3d359d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4ff019-cff5-4b00-a937-9aca3d359d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39e992e-f83e-4938-8531-15d8f232fa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Volume 01622154-50ff-4f52-9fdd-e596b3c7e12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01622154-50ff-4f52-9fdd-e596b3c7e12f', 'volume_size': 1} Sep 17 17:20:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:31 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d 1073741824" returned: 0 in 0.527s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:31 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d Sep 17 17:20:31 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Flow 'volume_create_manager' (cc8ebf7e-a8cc-48a1-9784-32ce2c997d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ee9a91-a020-4958-8ee9-88709678709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ee9a91-a020-4958-8ee9-88709678709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-991516767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05473554-cb4b-49ab-8f44-5109e029b000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279172a4da9d45f1bfa44089f7f32438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:31Z,use_quota=True,user_id='17c0c33133134d4c8ab2bae0a41043a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06a33fc-0b6c-4a96-9c0e-0ac7d9873072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06a33fc-0b6c-4a96-9c0e-0ac7d9873072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6d619c-db3a-4ac1-89e7-fead074fb9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6d619c-db3a-4ac1-89e7-fead074fb9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05473554-cb4b-49ab-8f44-5109e029b000', 'volume_name': 'volume-05473554-cb4b-49ab-8f44-5109e029b000', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50cbbd6-e674-4db2-b31a-9ccf26f4331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50cbbd6-e674-4db2-b31a-9ccf26f4331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553c14d3-6d3f-44c1-bfe2-310a5a083d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Volume 05473554-cb4b-49ab-8f44-5109e029b000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05473554-cb4b-49ab-8f44-5109e029b000', 'volume_size': 1} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:31 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d" returned: 0 in 0.304s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-607944631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa5bf4a-a149-43de-b866-77d5b26c9b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279172a4da9d45f1bfa44089f7f32438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:30Z,use_quota=True,user_id='17c0c33133134d4c8ab2bae0a41043a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Creating volume daa5bf4a-a149-43de-b866-77d5b26c9b33 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:31 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222eb4f4-b320-45ff-a3c7-6a7a16903113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905ab239-eabf-4206-be96-d8c8345b831d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:31 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33 1073741824 Sep 17 17:20:31 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67170d00-d2e7-46c1-ae5f-12c473244d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Volume volume-905ab239-eabf-4206-be96-d8c8345b831d (905ab239-eabf-4206-be96-d8c8345b831d): created successfully Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67170d00-d2e7-46c1-ae5f-12c473244d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Flow 'volume_create_manager' (6e38c4c5-e6da-453a-b9d4-4466e28ea97d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c9488b97-8cd4-44f5-b011-e9d7a03180be tempest-VolumeDependencyTests-1074931634 None] Created volume successfully. Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Flow 'volume_create_manager' (7ea57645-4489-458f-860e-5176a8f900a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4db49d-bfa7-4558-8289-281fdbb7292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4db49d-bfa7-4558-8289-281fdbb7292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968299797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03370662-ca96-41d5-82a2-19e1b5866580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279172a4da9d45f1bfa44089f7f32438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:32Z,use_quota=True,user_id='17c0c33133134d4c8ab2bae0a41043a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119ee40f-020a-4439-adbb-5b5039a052db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119ee40f-020a-4439-adbb-5b5039a052db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33679a82-9988-4647-aac8-ace88f9a2c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33679a82-9988-4647-aac8-ace88f9a2c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03370662-ca96-41d5-82a2-19e1b5866580', 'volume_name': 'volume-03370662-ca96-41d5-82a2-19e1b5866580', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b93036-d85d-4475-a740-7534989a4ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b93036-d85d-4475-a740-7534989a4ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c23316b-2ea7-45e9-ab7b-1acbd0695a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:31 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Volume 03370662-ca96-41d5-82a2-19e1b5866580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03370662-ca96-41d5-82a2-19e1b5866580', 'volume_size': 1} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:32 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33 1073741824" returned: 0 in 0.654s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:32 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33 Sep 17 17:20:32 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Flow 'volume_create_manager' (5e931679-716e-4b19-8215-05b276e73bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3085850-80be-4197-bc0c-215613327e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3085850-80be-4197-bc0c-215613327e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-827289304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279172a4da9d45f1bfa44089f7f32438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:32Z,use_quota=True,user_id='17c0c33133134d4c8ab2bae0a41043a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08d8694-aa0f-4166-90b9-bb608618843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08d8694-aa0f-4166-90b9-bb608618843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f393491e-f3ab-43e3-97cb-9c34657d61c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f393491e-f3ab-43e3-97cb-9c34657d61c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce', 'volume_name': 'volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4852c83-e4db-4964-ab73-369d24530a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4852c83-e4db-4964-ab73-369d24530a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d206dff7-f0e5-4f33-96c9-d95e291d5c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:32 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Volume eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce', 'volume_size': 1} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:32 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33" returned: 0 in 0.267s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-889679971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01622154-50ff-4f52-9fdd-e596b3c7e12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279172a4da9d45f1bfa44089f7f32438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:31Z,use_quota=True,user_id='17c0c33133134d4c8ab2bae0a41043a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Creating volume 01622154-50ff-4f52-9fdd-e596b3c7e12f {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:32 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db126598-4f06-4909-9f0c-aae5e34c3786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa5bf4a-a149-43de-b866-77d5b26c9b33', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:32 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f 1073741824 Sep 17 17:20:32 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1bacd7-e2e8-4c1e-b4fe-3e78d72b3409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:32 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Volume volume-daa5bf4a-a149-43de-b866-77d5b26c9b33 (daa5bf4a-a149-43de-b866-77d5b26c9b33): created successfully Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1bacd7-e2e8-4c1e-b4fe-3e78d72b3409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Flow 'volume_create_manager' (37c2ce26-6520-4a5c-8796-f9d160125100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-583da63b-b147-44b1-9104-e467a13566d1 tempest-CreateVolumesFromImageTest-740482651 None] Created volume successfully. Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:32 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f 1073741824" returned: 0 in 0.520s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:33 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f Sep 17 17:20:33 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:33 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.863s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-991516767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05473554-cb4b-49ab-8f44-5109e029b000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279172a4da9d45f1bfa44089f7f32438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:31Z,use_quota=True,user_id='17c0c33133134d4c8ab2bae0a41043a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Creating volume 05473554-cb4b-49ab-8f44-5109e029b000 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:33 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39e992e-f83e-4938-8531-15d8f232fa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01622154-50ff-4f52-9fdd-e596b3c7e12f', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:33 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000 1073741824 Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69143ddd-d770-4828-a2eb-e71d93eb91b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:33 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:33 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Volume volume-01622154-50ff-4f52-9fdd-e596b3c7e12f (01622154-50ff-4f52-9fdd-e596b3c7e12f): created successfully Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69143ddd-d770-4828-a2eb-e71d93eb91b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Flow 'volume_create_manager' (5c86a996-2ab7-424c-9211-2f439cbfb059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:33 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bfd3869a-0843-4157-b1aa-bd30854e27d3 tempest-CreateVolumesFromImageTest-740482651 None] Created volume successfully. Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Flow 'volume_create_manager' (13f2bbca-5359-452d-8ef8-a1baaa05922e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87151520-0ff1-46c0-a35f-6a2020d28ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87151520-0ff1-46c0-a35f-6a2020d28ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff97ab6-924b-43d8-8f7c-49bcd4116b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4b0d66d60f46ef9b68756038d07f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:34Z,use_quota=True,user_id='33d652a7085c49d6858ddf9e7c0d6d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(749e9d9b-b463-4790-8529-f1572ba27c1a),volume_type_id=749e9d9b-b463-4790-8529-f1572ba27c1a)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd27b8db-4832-4d46-9da3-71babfaf95af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd27b8db-4832-4d46-9da3-71babfaf95af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9255f09a-e936-4c89-9089-ef066c67b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.image.glance [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Creating Keystone auth plugin from conf {{(pid=85889) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 17:20:33 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000 1073741824" returned: 0 in 0.473s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:33 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000 Sep 17 17:20:33 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9255f09a-e936-4c89-9089-ef066c67b54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ff97ab6-924b-43d8-8f7c-49bcd4116b51', 'volume_name': 'volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51', 'volume_size': 1, 'image_id': 'f6f1af20-951d-484f-a584-9d9c273b2222', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6f1af20-951d-484f-a584-9d9c273b2222', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aad1316b5c49bd30b7b39da72e39c67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a4b0d66d60f46ef9b68756038d07f4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45e49df204b6e007e2be1477a9a388527cc560438bdf3cc7b16ebd1b30b4dd48ce3074d8e05aada91af1699a0f97e7101935166148a65172e439585874351e14', 'id': 'f6f1af20-951d-484f-a584-9d9c273b2222', 'created_at': datetime.datetime(2026, 9, 17, 15, 20, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 20, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6f1af20-951d-484f-a584-9d9c273b2222/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd700cc-c3b1-47ab-99e1-2c01a045984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd700cc-c3b1-47ab-99e1-2c01a045984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e8b914-723f-476c-83d3-b2457a6a4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:33 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Volume 4ff97ab6-924b-43d8-8f7c-49bcd4116b51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51', 'volume_size': 1, 'image_id': 'f6f1af20-951d-484f-a584-9d9c273b2222', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6f1af20-951d-484f-a584-9d9c273b2222', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aad1316b5c49bd30b7b39da72e39c67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a4b0d66d60f46ef9b68756038d07f4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45e49df204b6e007e2be1477a9a388527cc560438bdf3cc7b16ebd1b30b4dd48ce3074d8e05aada91af1699a0f97e7101935166148a65172e439585874351e14', 'id': 'f6f1af20-951d-484f-a584-9d9c273b2222', 'created_at': datetime.datetime(2026, 9, 17, 15, 20, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 20, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6f1af20-951d-484f-a584-9d9c273b2222/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 17:20:33 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Trying to clone 4ff97ab6-924b-43d8-8f7c-49bcd4116b51 from image f6f1af20-951d-484f-a584-9d9c273b2222 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6f1af20-951d-484f-a584-9d9c273b2222', 'metadata': {}}]). {{(pid=85889) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 17:20:34 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000" returned: 0 in 0.258s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.096s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1968299797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03370662-ca96-41d5-82a2-19e1b5866580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279172a4da9d45f1bfa44089f7f32438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:32Z,use_quota=True,user_id='17c0c33133134d4c8ab2bae0a41043a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Creating volume 03370662-ca96-41d5-82a2-19e1b5866580 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:34 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 17:20:34 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Image download 0.00 MB at 0.00 MB/s Sep 17 17:20:34 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580 1073741824 Sep 17 17:20:34 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553c14d3-6d3f-44c1-bfe2-310a5a083d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05473554-cb4b-49ab-8f44-5109e029b000', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bea915a-6c40-4057-b135-2e215504c1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:34 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Volume volume-05473554-cb4b-49ab-8f44-5109e029b000 (05473554-cb4b-49ab-8f44-5109e029b000): created successfully Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bea915a-6c40-4057-b135-2e215504c1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Flow 'volume_create_manager' (cc8ebf7e-a8cc-48a1-9784-32ce2c997d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[985469e7-9664-470f-9591-c1fb757d029c]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ae723016-83f5-42f1-8435-c9a246026675 tempest-CreateVolumesFromImageTest-740482651 None] Created volume successfully. Sep 17 17:20:34 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD Sep 17 17:20:34 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:34 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580 1073741824" returned: 0 in 0.426s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:34 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:34 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580 Sep 17 17:20:34 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:34 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD Sep 17 17:20:34 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:34 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580" returned: 0 in 0.241s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.803s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c23316b-2ea7-45e9-ab7b-1acbd0695a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03370662-ca96-41d5-82a2-19e1b5866580', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8869e1f-2322-4b37-8737-72d162b3a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Creating offline snapshot 41ca34a5-8af6-4881-ae69-342618c0ac5c of volume b48c2e3a-d889-4bf8-b547-be7304255fbb {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:20:34 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Volume volume-03370662-ca96-41d5-82a2-19e1b5866580 (03370662-ca96-41d5-82a2-19e1b5866580): created successfully Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8869e1f-2322-4b37-8737-72d162b3a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Flow 'volume_create_manager' (7ea57645-4489-458f-860e-5176a8f900a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b072a9-e2d4-4720-8781-71780cc58d4d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-954be822-9aa2-49bf-a873-a48ab6ff2e0e tempest-CreateVolumesFromImageTest-740482651 None] Created volume successfully. Sep 17 17:20:34 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Temporary image f6f1af20-951d-484f-a584-9d9c273b2222 is fetched for user 33d652a7085c49d6858ddf9e7c0d6d21. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 17:20:34 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb Sep 17 17:20:34 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f69e25-f014-4a61-9ee3-7ad69d2fa730]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:35 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD Sep 17 17:20:35 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:35 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb" returned: 0 in 0.383s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:35 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c 1G Sep 17 17:20:35 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:35 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:35 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD Sep 17 17:20:35 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:35 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c 1G" returned: 0 in 0.437s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48c2e3a-d889-4bf8-b547-be7304255fbb -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:35 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:35 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48c2e3a-d889-4bf8-b547-be7304255fbb -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c Sep 17 17:20:35 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:35 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48c2e3a-d889-4bf8-b547-be7304255fbb -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c" returned: 0 in 0.287s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:35 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c is being set with open permissions: ugo+rw Sep 17 17:20:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:35 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c Sep 17 17:20:35 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:36 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c" returned: 0 in 0.244s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:36 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.info Sep 17 17:20:36 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:36 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.info" returned: 0 in 0.245s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:36 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.info is being set with open permissions: ugo+rw Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:36 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.info Sep 17 17:20:36 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:36 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.info" returned: 0 in 0.245s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.358s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-827289304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279172a4da9d45f1bfa44089f7f32438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:32Z,use_quota=True,user_id='17c0c33133134d4c8ab2bae0a41043a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Creating volume eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:36 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:36 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce 1073741824 Sep 17 17:20:36 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:36 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0a8108b8-fcf4-43c6-a48d-1b4c130ed447 tempest-CreateVolumesFromSnapshotTest-183439184 None] Create snapshot completed successfully Sep 17 17:20:37 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce 1073741824" returned: 0 in 0.448s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:37 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce Sep 17 17:20:37 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:37 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (4c7e8f4e-a2bb-4897-9575-bb5996de03ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3708e621-0cd8-4843-af09-3c46854e3f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce" returned: 0 in 0.301s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.648s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d206dff7-f0e5-4f33-96c9-d95e291d5c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec36a09c-cab9-4b1a-946c-0c87a0a47b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3708e621-0cd8-4843-af09-3c46854e3f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-927351655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d0b787-ecc1-4aac-9973-3fd14547173d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:37Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f2220e-de4a-4432-9f25-16ace16ffc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f2220e-de4a-4432-9f25-16ace16ffc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040a5ba8-b6bf-4ae5-8e5f-f61b53464894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040a5ba8-b6bf-4ae5-8e5f-f61b53464894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d0b787-ecc1-4aac-9973-3fd14547173d', 'volume_name': 'volume-88d0b787-ecc1-4aac-9973-3fd14547173d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4eb49a-6638-4453-992b-d7c9fa15972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4eb49a-6638-4453-992b-d7c9fa15972b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191a34e5-4e88-4f59-a044-c4d8da81a9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:37 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume 88d0b787-ecc1-4aac-9973-3fd14547173d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d0b787-ecc1-4aac-9973-3fd14547173d', 'volume_size': 1} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Creating offline snapshot 0819f549-69c2-4bbc-b85e-fa7d025957c1 of volume 905ab239-eabf-4206-be96-d8c8345b831d {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:20:37 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Volume volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce (eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce): created successfully Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec36a09c-cab9-4b1a-946c-0c87a0a47b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Flow 'volume_create_manager' (5e931679-716e-4b19-8215-05b276e73bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfc2f7f-9cee-4ff4-8f39-60b570989cba]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a46e5840-8eb2-4c6a-a343-20861e7015a9 tempest-CreateVolumesFromImageTest-740482651 None] Created volume successfully. Sep 17 17:20:37 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d Sep 17 17:20:37 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "cinder-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (63e756be-c726-49c8-b7bb-a5d2b82aa435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6283a191-839c-426d-a242-5926868b2f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6283a191-839c-426d-a242-5926868b2f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-354943211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71b7f1a-6837-473e-aefa-0677b893e2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:38Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858bbf3b-80f6-4401-83aa-f19f283d22f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858bbf3b-80f6-4401-83aa-f19f283d22f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a201abf-047a-4637-b894-21f3e8f43bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a201abf-047a-4637-b894-21f3e8f43bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f71b7f1a-6837-473e-aefa-0677b893e2ed', 'volume_name': 'volume-f71b7f1a-6837-473e-aefa-0677b893e2ed', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753495cd-d376-4186-a76e-8d4a34925ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753495cd-d376-4186-a76e-8d4a34925ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85d1f49-f2c9-43bc-a2b7-bbfe2500cc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume f71b7f1a-6837-473e-aefa-0677b893e2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f71b7f1a-6837-473e-aefa-0677b893e2ed', 'volume_size': 1} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "cinder-quobyte-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-quobyte-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c949d9c7-1e48-46be-8773-e078c04d2fd2]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:38 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d" returned: 0 in 0.545s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:38 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce Sep 17 17:20:38 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:38 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 1G Sep 17 17:20:38 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (eaeb0246-6ed4-48f4-9971-4a85911aff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c93fb0-9a45-478e-bea4-e42b309f9f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c93fb0-9a45-478e-bea4-e42b309f9f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1387298552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6b0dd9-1a7a-457a-8b4d-836babfb3db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:38Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3869187-ebbc-44da-adea-5df88617a019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3869187-ebbc-44da-adea-5df88617a019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46036c7c-acdc-4137-994e-e00a4092052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46036c7c-acdc-4137-994e-e00a4092052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b6b0dd9-1a7a-457a-8b4d-836babfb3db8', 'volume_name': 'volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8626ffe-65d3-406b-9c5f-0e2b8d28b9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8626ffe-65d3-406b-9c5f-0e2b8d28b9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e833c5-ba8b-4f6d-ab8f-f4408e184838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume 5b6b0dd9-1a7a-457a-8b4d-836babfb3db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8', 'volume_size': 1} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:38 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce" returned: 0 in 0.473s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:38 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce Sep 17 17:20:38 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (c6e5a23b-27ca-4542-8729-c5c6878d44e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:38 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30b3e49-130d-47f0-8e5b-ffbdfd818bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 1G" returned: 0 in 0.580s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905ab239-eabf-4206-be96-d8c8345b831d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30b3e49-130d-47f0-8e5b-ffbdfd818bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088238112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b78fbe-3ad5-44a9-b834-62c940988db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:39Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:38 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905ab239-eabf-4206-be96-d8c8345b831d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 Sep 17 17:20:38 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621b4fbf-552e-478c-8c50-50e6d020110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621b4fbf-552e-478c-8c50-50e6d020110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b8abec-3691-4fb0-bc23-2ff1898e7efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b8abec-3691-4fb0-bc23-2ff1898e7efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b78fbe-3ad5-44a9-b834-62c940988db0', 'volume_name': 'volume-36b78fbe-3ad5-44a9-b834-62c940988db0', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb9f7e3-6265-43d7-9d9e-be0b0cef0f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb9f7e3-6265-43d7-9d9e-be0b0cef0f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374e28a7-7b81-41de-9693-5fdeb07e8ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:38 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume 36b78fbe-3ad5-44a9-b834-62c940988db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b78fbe-3ad5-44a9-b834-62c940988db0', 'volume_size': 1} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:38 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce" returned: 0 in 0.365s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-quobyte-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce" released by "delete_volume" :: held 0.907s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Created reservations ['da6cf265-dfc5-488a-aa92-f27a52d4c9bf', '562fcbc5-ff34-41d5-a28d-2bb5a03320b8', '5492b406-c348-45e7-a651-59bc3d3fc25f', '3423988a-d6c8-4554-9b69-4e93f50a59ad'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:39 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (4e546771-7c4a-4151-892b-eb0701cb691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17f9b4a-4d00-43b7-b714-1bdde5fe1953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905ab239-eabf-4206-be96-d8c8345b831d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1" returned: 0 in 0.421s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:39 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 is being set with open permissions: ugo+rw Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:39 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:39 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17f9b4a-4d00-43b7-b714-1bdde5fe1953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-378021718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be90d927-1b84-4b5f-b9e0-5bbae8e26907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:39Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ddbdac-d4c1-4062-80b1-58ffb75f046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:39 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 Sep 17 17:20:39 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ddbdac-d4c1-4062-80b1-58ffb75f046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7328ddc-c3e7-4d61-85b5-6e26b0b766bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7328ddc-c3e7-4d61-85b5-6e26b0b766bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be90d927-1b84-4b5f-b9e0-5bbae8e26907', 'volume_name': 'volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ed8ad1-4d54-4d2b-a695-7256048100a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ed8ad1-4d54-4d2b-a695-7256048100a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0609565-f92b-457e-b791-c78b334f6067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:39 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume be90d927-1b84-4b5f-b9e0-5bbae8e26907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907', 'volume_size': 1} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:39 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.258s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:39 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Deleted volume successfully. Sep 17 17:20:39 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1" returned: 0 in 0.252s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-83343f8d-83a7-413f-a0b0-82e6a60c7118 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-eaa8d056-04be-4dcb-ab5e-2edd7e8d75ce-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:39 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.info Sep 17 17:20:39 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:39 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.info" returned: 0 in 0.256s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:39 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.info is being set with open permissions: ugo+rw Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:39 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.info Sep 17 17:20:39 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:39 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.info" returned: 0 in 0.244s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.334s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff97ab6-924b-43d8-8f7c-49bcd4116b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4b0d66d60f46ef9b68756038d07f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:34Z,use_quota=True,user_id='33d652a7085c49d6858ddf9e7c0d6d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(749e9d9b-b463-4790-8529-f1572ba27c1a),volume_type_id=749e9d9b-b463-4790-8529-f1572ba27c1a)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Creating volume 4ff97ab6-924b-43d8-8f7c-49bcd4116b51 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:40 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:40 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 1073741824 Sep 17 17:20:40 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-694bb2eb-398d-4791-986d-747ce4b483c2 tempest-VolumeDependencyTests-1074931634 None] Create snapshot completed successfully Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "cinder-03370662-ca96-41d5-82a2-19e1b5866580-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-03370662-ca96-41d5-82a2-19e1b5866580-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "cinder-quobyte-03370662-ca96-41d5-82a2-19e1b5866580" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-quobyte-03370662-ca96-41d5-82a2-19e1b5866580" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee6411c-4a83-453d-9a59-29034cbf1a39]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:40 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580 Sep 17 17:20:40 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:40 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 1073741824" returned: 0 in 0.511s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:40 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 Sep 17 17:20:40 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:40 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580" returned: 0 in 0.420s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:40 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580 Sep 17 17:20:40 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Flow 'volume_create_manager' (5be23776-d277-498d-8c38-537bcc50030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdbb37b-4f5e-4ef4-8b02-33e782f4adf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:40 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdbb37b-4f5e-4ef4-8b02-33e782f4adf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-683579104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0424ca-4b15-4692-9ed3-48f2569e6586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9920b7a66329490b8bdec59fc9b1e463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0819f549-69c2-4bbc-b85e-fa7d025957c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:41Z,use_quota=True,user_id='7c5b1341609345489a32831bbafb5cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211e2ce3-01dd-4652-9671-ae6c00d2717e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211e2ce3-01dd-4652-9671-ae6c00d2717e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a542d1-1813-4c73-8943-e8b32167eadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a542d1-1813-4c73-8943-e8b32167eadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a0424ca-4b15-4692-9ed3-48f2569e6586', 'volume_name': 'volume-8a0424ca-4b15-4692-9ed3-48f2569e6586', 'volume_size': 1, 'snapshot_id': '0819f549-69c2-4bbc-b85e-fa7d025957c1'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d61eb-909b-4bf8-91c2-569ad0ba405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d61eb-909b-4bf8-91c2-569ad0ba405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdcc40b-1975-492c-b193-a4ae9470e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:40 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Volume 8a0424ca-4b15-4692-9ed3-48f2569e6586: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a0424ca-4b15-4692-9ed3-48f2569e6586', 'volume_size': 1, 'snapshot_id': '0819f549-69c2-4bbc-b85e-fa7d025957c1'} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51" returned: 0 in 0.337s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.313s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-927351655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d0b787-ecc1-4aac-9973-3fd14547173d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:37Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Creating volume 88d0b787-ecc1-4aac-9973-3fd14547173d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:40 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:40 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-03370662-ca96-41d5-82a2-19e1b5866580" returned: 0 in 0.268s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:40 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d 1073741824 Sep 17 17:20:40 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-quobyte-03370662-ca96-41d5-82a2-19e1b5866580" released by "delete_volume" :: held 0.757s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:40 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Attempting download of f6f1af20-951d-484f-a584-9d9c273b2222 ((None, [{'url': 'file:///opt/stack/data/glance/images/f6f1af20-951d-484f-a584-9d9c273b2222', 'metadata': {}}])) to volume 4ff97ab6-924b-43d8-8f7c-49bcd4116b51. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e0c061-180c-4600-9886-1aaaeb7aa7ee]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6f1af20-951d-484f-a584-9d9c273b2222_egl0apof {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Created reservations ['06d3e5ff-42c7-4683-ad36-8ef811031fb8', '03aecadd-4faa-4eda-be3a-03c62b86dd63', '7033a3e7-efea-41fa-ad15-43418668fd65', '0dcad7f9-f2e5-4233-8269-8a6e90350849'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:41 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6f1af20-951d-484f-a584-9d9c273b2222_egl0apof Sep 17 17:20:41 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:41 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:41 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "cinder-05473554-cb4b-49ab-8f44-5109e029b000-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-05473554-cb4b-49ab-8f44-5109e029b000-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "cinder-quobyte-05473554-cb4b-49ab-8f44-5109e029b000" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-quobyte-05473554-cb4b-49ab-8f44-5109e029b000" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:41 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6f1af20-951d-484f-a584-9d9c273b2222_egl0apof" returned: 0 in 0.401s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6f1af20-951d-484f-a584-9d9c273b2222_egl0apof {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f8d18f-3ea0-4b0d-8024-a8fa3abf9166]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:41 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.374s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:41 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d 1073741824" returned: 0 in 0.605s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Deleted volume successfully. Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b310a3c-b6a3-4692-a7d3-9a8b723c900c tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-03370662-ca96-41d5-82a2-19e1b5866580-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:41 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6f1af20-951d-484f-a584-9d9c273b2222_egl0apof Sep 17 17:20:41 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:41 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d Sep 17 17:20:41 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:41 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000 Sep 17 17:20:41 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:41 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6f1af20-951d-484f-a584-9d9c273b2222_egl0apof" returned: 1 in 0.370s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6f1af20-951d-484f-a584-9d9c273b2222_egl0apof' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d84c3f-f8e7-40e5-8df9-0d18c56edcc2]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:41 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d" returned: 0 in 0.274s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.898s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-354943211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f71b7f1a-6837-473e-aefa-0677b893e2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:38Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Creating volume f71b7f1a-6837-473e-aefa-0677b893e2ed {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:41 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191a34e5-4e88-4f59-a044-c4d8da81a9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d0b787-ecc1-4aac-9973-3fd14547173d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:41 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed 1073741824 Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314c31fd-a55f-4fb8-9fb3-7e595424cf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:41 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:41 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000" returned: 0 in 0.484s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:41 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD Sep 17 17:20:41 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:41 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume volume-88d0b787-ecc1-4aac-9973-3fd14547173d (88d0b787-ecc1-4aac-9973-3fd14547173d): created successfully Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314c31fd-a55f-4fb8-9fb3-7e595424cf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:41 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000 Sep 17 17:20:41 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (4c7e8f4e-a2bb-4897-9575-bb5996de03ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:41 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c14d0500-b4fb-4db0-b8b3-f485822bef41 tempest-CreateVolumesFromSnapshotTest-183439184 None] Created volume successfully. Sep 17 17:20:42 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:42 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-05473554-cb4b-49ab-8f44-5109e029b000" returned: 0 in 0.305s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-quobyte-05473554-cb4b-49ab-8f44-5109e029b000" released by "delete_volume" :: held 0.847s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Created reservations ['18c3c371-a426-41c2-b07d-ab9eac3e3089', '2c58bfd6-9d5b-49f0-bead-1b0bec499811', '7810921c-b45a-45a2-8d68-baa780495871', 'f9610643-9e3c-4ecf-9182-d9f0c479ae18'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:42 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD Sep 17 17:20:42 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:42 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed 1073741824" returned: 0 in 0.525s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:42 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:42 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:42 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed Sep 17 17:20:42 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "cinder-01622154-50ff-4f52-9fdd-e596b3c7e12f-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:42 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-01622154-50ff-4f52-9fdd-e596b3c7e12f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] f6f1af20-951d-484f-a584-9d9c273b2222 was raw, converting to qcow2 {{(pid=85889) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:42 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 Sep 17 17:20:42 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "cinder-quobyte-01622154-50ff-4f52-9fdd-e596b3c7e12f" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-quobyte-01622154-50ff-4f52-9fdd-e596b3c7e12f" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:42 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1fbc88-96ab-4ded-a844-6ea72f86f57a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.335s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:42 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Deleted volume successfully. Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-742ed541-20a7-4dd6-9a56-8b7ba0762a39 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-05473554-cb4b-49ab-8f44-5109e029b000-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:42 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed" returned: 0 in 0.354s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.422s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1387298552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6b0dd9-1a7a-457a-8b4d-836babfb3db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:38Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Creating volume 5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:42 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:42 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f Sep 17 17:20:42 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:42 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 1073741824 Sep 17 17:20:42 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85d1f49-f2c9-43bc-a2b7-bbfe2500cc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f71b7f1a-6837-473e-aefa-0677b893e2ed', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4687b7aa-17d9-4936-96b9-61fcbe9ffae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:42 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume volume-f71b7f1a-6837-473e-aefa-0677b893e2ed (f71b7f1a-6837-473e-aefa-0677b893e2ed): created successfully Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4687b7aa-17d9-4936-96b9-61fcbe9ffae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (63e756be-c726-49c8-b7bb-a5d2b82aa435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:42 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-37d1345d-d2f2-470f-a553-72de7d04cae8 tempest-CreateVolumesFromSnapshotTest-183439184 None] Created volume successfully. Sep 17 17:20:43 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51" returned: 0 in 0.565s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6f1af20-951d-484f-a584-9d9c273b2222_yliucy1cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:20:43 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:43 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f" returned: 0 in 0.461s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:43 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 1G Sep 17 17:20:43 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:43 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f Sep 17 17:20:43 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:43 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 1073741824" returned: 0 in 0.522s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:43 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 Sep 17 17:20:43 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:43 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-01622154-50ff-4f52-9fdd-e596b3c7e12f" returned: 0 in 0.302s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-quobyte-01622154-50ff-4f52-9fdd-e596b3c7e12f" released by "delete_volume" :: held 0.823s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:43 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 1G" returned: 0 in 0.357s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Downloaded image f6f1af20-951d-484f-a584-9d9c273b2222 ((None, [{'url': 'file:///opt/stack/data/glance/images/f6f1af20-951d-484f-a584-9d9c273b2222', 'metadata': {}}])) to volume 4ff97ab6-924b-43d8-8f7c-49bcd4116b51 successfully. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Temporary image f6f1af20-951d-484f-a584-9d9c273b2222 for user 33d652a7085c49d6858ddf9e7c0d6d21 is deleted. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Marking volume 4ff97ab6-924b-43d8-8f7c-49bcd4116b51 as bootable. {{(pid=85889) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Copying metadata from image f6f1af20-951d-484f-a584-9d9c273b2222 to 4ff97ab6-924b-43d8-8f7c-49bcd4116b51. {{(pid=85889) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Creating volume glance metadata for volume 4ff97ab6-924b-43d8-8f7c-49bcd4116b51 backed by image f6f1af20-951d-484f-a584-9d9c273b2222 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f6f1af20-951d-484f-a584-9d9c273b2222', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7aad1316b5c49bd30b7b39da72e39c67', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85889) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Created reservations ['bb29d6cf-5301-44ee-be4e-adc35cc2ef79', '3fca213e-ae82-4446-8d86-d01cc0427f32', 'cd8ee8aa-a469-4735-80df-c6ac99d9fb2e', '2a8f64b4-2a3f-4878-a5b5-ec56cbf526e3'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e8b914-723f-476c-83d3-b2457a6a4537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51', 'volume_size': 1, 'image_id': 'f6f1af20-951d-484f-a584-9d9c273b2222', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6f1af20-951d-484f-a584-9d9c273b2222', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7aad1316b5c49bd30b7b39da72e39c67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a4b0d66d60f46ef9b68756038d07f4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45e49df204b6e007e2be1477a9a388527cc560438bdf3cc7b16ebd1b30b4dd48ce3074d8e05aada91af1699a0f97e7101935166148a65172e439585874351e14', 'id': 'f6f1af20-951d-484f-a584-9d9c273b2222', 'created_at': datetime.datetime(2026, 9, 17, 15, 20, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 20, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6f1af20-951d-484f-a584-9d9c273b2222/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f856be-a429-4ce1-a956-39e80617ef5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:43 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Volume volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 (4ff97ab6-924b-43d8-8f7c-49bcd4116b51): created successfully Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f856be-a429-4ce1-a956-39e80617ef5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Flow 'volume_create_manager' (13f2bbca-5359-452d-8ef8-a1baaa05922e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:43 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8" returned: 0 in 0.286s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.827s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088238112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b78fbe-3ad5-44a9-b834-62c940988db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:39Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Creating volume 36b78fbe-3ad5-44a9-b834-62c940988db0 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:43 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:43 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:43 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:43 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-2e0e2363-1ea5-4fdc-9b68-cb50f54f212e tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Created volume successfully. Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "cinder-daa5bf4a-a149-43de-b866-77d5b26c9b33-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:43 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0 1073741824 Sep 17 17:20:43 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e833c5-ba8b-4f6d-ab8f-f4408e184838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fe2084-2ac0-47f8-bf91-5273c2d9f8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:43 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 (5b6b0dd9-1a7a-457a-8b4d-836babfb3db8): created successfully Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fe2084-2ac0-47f8-bf91-5273c2d9f8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (eaeb0246-6ed4-48f4-9971-4a85911aff0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-daa5bf4a-a149-43de-b866-77d5b26c9b33-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:43 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e5f4a0ea-af77-46ae-a5bb-6c9cd3f63c0c tempest-CreateVolumesFromSnapshotTest-183439184 None] Created volume successfully. Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "cinder-quobyte-daa5bf4a-a149-43de-b866-77d5b26c9b33" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-quobyte-daa5bf4a-a149-43de-b866-77d5b26c9b33" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8faa037-f82c-42d1-8551-3e5ab8848c39]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:44 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.338s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Deleted volume successfully. Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b97b2700-cb55-476a-bd74-c52c8d7167e4 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-01622154-50ff-4f52-9fdd-e596b3c7e12f-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:44 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33 Sep 17 17:20:44 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:44 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0 1073741824" returned: 0 in 0.523s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Acquiring lock "cinder-4ff97ab6-924b-43d8-8f7c-49bcd4116b51-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:44 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0 Sep 17 17:20:44 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Lock "cinder-4ff97ab6-924b-43d8-8f7c-49bcd4116b51-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Acquiring lock "cinder-quobyte-4ff97ab6-924b-43d8-8f7c-49bcd4116b51" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:44 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33" returned: 0 in 0.424s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Lock "cinder-quobyte-4ff97ab6-924b-43d8-8f7c-49bcd4116b51" acquired by "delete_volume" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:44 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33 Sep 17 17:20:44 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3821af2d-a84f-4ee5-a163-edeb637583c0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:44 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 Sep 17 17:20:44 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:44 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0" returned: 0 in 0.303s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.342s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-378021718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be90d927-1b84-4b5f-b9e0-5bbae8e26907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216e835d970d44339c73a45b8c4d8a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:39Z,use_quota=True,user_id='1fc26db6b7f4472c9c715cabe8500bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Creating volume be90d927-1b84-4b5f-b9e0-5bbae8e26907 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:44 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374e28a7-7b81-41de-9693-5fdeb07e8ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b78fbe-3ad5-44a9-b834-62c940988db0', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:44 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907 1073741824 Sep 17 17:20:44 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1067316d-1a34-468d-8f31-8f0fac530934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:44 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume volume-36b78fbe-3ad5-44a9-b834-62c940988db0 (36b78fbe-3ad5-44a9-b834-62c940988db0): created successfully Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1067316d-1a34-468d-8f31-8f0fac530934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (c6e5a23b-27ca-4542-8729-c5c6878d44e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:44 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-daa5bf4a-a149-43de-b866-77d5b26c9b33" returned: 0 in 0.293s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1903ac7a-5e4c-46f2-b631-2a788b1225fe tempest-CreateVolumesFromSnapshotTest-183439184 None] Created volume successfully. Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-quobyte-daa5bf4a-a149-43de-b866-77d5b26c9b33" released by "delete_volume" :: held 0.763s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Created reservations ['08f34e2f-eb67-4cb7-a1a8-74ba64b54fe8', 'cee8e988-37e3-464f-90c8-56ff63c415c2', 'e5dc14e7-60bc-47fb-87ed-5634bf24dfab', '0ec67930-c60a-4e9a-bf53-aeb24f85980f'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:44 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:44 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:44 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51" returned: 0 in 0.432s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:44 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51 Sep 17 17:20:44 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:45 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:45 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.299s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907 1073741824" returned: 0 in 0.512s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Deleted volume successfully. Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1973fa5a-bec0-461d-9a09-e2e0beebc673 tempest-CreateVolumesFromImageTest-740482651 None] Lock "cinder-daa5bf4a-a149-43de-b866-77d5b26c9b33-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:45 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-4ff97ab6-924b-43d8-8f7c-49bcd4116b51" returned: 0 in 0.321s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:45 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907 Sep 17 17:20:45 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Lock "cinder-quobyte-4ff97ab6-924b-43d8-8f7c-49bcd4116b51" released by "delete_volume" :: held 0.806s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Created reservations ['380d507c-7cb3-481d-add8-00ca0c035fef', 'f236ea19-9dea-4c70-b205-f4f35e4518c5', '442dc280-ea58-47f8-b940-b4970b85cdad', '15e54746-f7c2-4f34-bd6e-4ec591d4ccd6'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:45 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:45 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:45 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907" returned: 0 in 0.288s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.520s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "cinder-quobyte-0819f549-69c2-4bbc-b85e-fa7d025957c1-8a0424ca-4b15-4692-9ed3-48f2569e6586" by "_create_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0609565-f92b-457e-b791-c78b334f6067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a7a470-f4f8-4327-ac6b-46412f17a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:45 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Volume volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907 (be90d927-1b84-4b5f-b9e0-5bbae8e26907): created successfully Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a7a470-f4f8-4327-ac6b-46412f17a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Flow 'volume_create_manager' (4e546771-7c4a-4151-892b-eb0701cb691c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-0819f549-69c2-4bbc-b85e-fa7d025957c1-8a0424ca-4b15-4692-9ed3-48f2569e6586" acquired by "_create_volume_from_snapshot" :: waited 0.077s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Creating volume 8a0424ca-4b15-4692-9ed3-48f2569e6586 from snapshot 0819f549-69c2-4bbc-b85e-fa7d025957c1 {{(pid=85889) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "cinder-quobyte-8a0424ca-4b15-4692-9ed3-48f2569e6586" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c8ce120f-0eed-42f1-b380-bdb66fa20299 tempest-CreateVolumesFromSnapshotTest-183439184 None] Created volume successfully. Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-8a0424ca-4b15-4692-9ed3-48f2569e6586" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] snapshot: 0819f549-69c2-4bbc-b85e-fa7d025957c1, volume: 8a0424ca-4b15-4692-9ed3-48f2569e6586, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:20:45 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.374s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Deleted volume successfully. Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[beafb885-10a9-4e3f-a4dc-4824653c623c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-e7bc65de-8703-4809-b6b4-bad6c7c19b02 tempest-VolumeAndVolumeTypeFromImageTest-1287506781 None] Lock "cinder-4ff97ab6-924b-43d8-8f7c-49bcd4116b51-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-be90d927-1b84-4b5f-b9e0-5bbae8e26907-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-be90d927-1b84-4b5f-b9e0-5bbae8e26907-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:45 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 Sep 17 17:20:45 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-quobyte-be90d927-1b84-4b5f-b9e0-5bbae8e26907" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-be90d927-1b84-4b5f-b9e0-5bbae8e26907" acquired by "delete_volume" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08393f7-086a-40c2-9787-1ebbe04575d3]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:46 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907 Sep 17 17:20:46 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:46 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1" returned: 0 in 0.558s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905ab239-eabf-4206-be96-d8c8345b831d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ea3d9d-8d81-4c2d-8ccf-dfb2e79e85d9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:46 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d Sep 17 17:20:46 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:46 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907" returned: 0 in 0.481s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:46 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907 Sep 17 17:20:46 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:46 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d" returned: 0 in 0.486s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:46 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 Sep 17 17:20:46 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:46 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-be90d927-1b84-4b5f-b9e0-5bbae8e26907" returned: 0 in 0.317s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-be90d927-1b84-4b5f-b9e0-5bbae8e26907" released by "delete_volume" :: held 0.892s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:46 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Created reservations ['c5e98a0c-6a41-4d50-b89c-80294aad6189', '237b95bc-2f9d-4ca9-858e-baac5b5fb71b', '7b09e435-f469-4474-80b3-a4e0359c3da4', '38417b46-4bcc-4614-b1cc-3f759e37432a'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:47 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:47 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:47 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.355s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:47 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:47 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Deleted volume successfully. Sep 17 17:20:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-baaca092-9bb9-4005-9a16-cec989c7dce6 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-be90d927-1b84-4b5f-b9e0-5bbae8e26907-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-36b78fbe-3ad5-44a9-b834-62c940988db0-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-36b78fbe-3ad5-44a9-b834-62c940988db0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-quobyte-36b78fbe-3ad5-44a9-b834-62c940988db0" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-36b78fbe-3ad5-44a9-b834-62c940988db0" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:48 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afbdb1e-030e-4ff7-b7d8-b8b37aa4407b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:48 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0 Sep 17 17:20:48 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:49 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0" returned: 0 in 0.798s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:49 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0 Sep 17 17:20:49 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:49 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-36b78fbe-3ad5-44a9-b834-62c940988db0" returned: 0 in 0.391s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:49 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-36b78fbe-3ad5-44a9-b834-62c940988db0" released by "delete_volume" :: held 1.299s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:49 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Created reservations ['56a79e94-cbcb-4997-9bdf-d1ad6ae8a985', '37f5cdb0-74cb-4c86-acff-0564ea9c6f5f', '6e39666f-8d81-4ee1-a179-0ae99e6c38f4', '18b11b6d-2118-4ad1-9316-936d61b6011c'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:50 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:50 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:50 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.387s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:50 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:50 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Deleted volume successfully. Sep 17 17:20:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a084470f-7a09-4634-bf47-a193e3e55eee tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-36b78fbe-3ad5-44a9-b834-62c940988db0-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-quobyte-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:51 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8" acquired by "delete_volume" :: waited 0.046s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[428705cf-2938-4ad6-9603-f72eada12c6f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:51 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 Sep 17 17:20:51 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:52 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8" returned: 0 in 0.825s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:52 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8 Sep 17 17:20:52 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:52 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8" returned: 0 in 0.605s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8" released by "delete_volume" :: held 1.563s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Created reservations ['a8be57af-6d5b-4d00-b0db-f450f0f3ced0', '87249351-6e5b-4eef-aa8e-0124fb3cc66c', '5ff301ce-7283-47ab-8055-947852b5d98f', 'dcf66bea-91a9-42d0-ad5b-eb3f47c46ca4'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:53 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:53 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:53 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.426s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:53 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:53 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Deleted volume successfully. Sep 17 17:20:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f8df57e-4886-47c1-9c71-7e167ab85e4c tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-5b6b0dd9-1a7a-457a-8b4d-836babfb3db8-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-f71b7f1a-6837-473e-aefa-0677b893e2ed-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-f71b7f1a-6837-473e-aefa-0677b893e2ed-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-quobyte-f71b7f1a-6837-473e-aefa-0677b893e2ed" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-f71b7f1a-6837-473e-aefa-0677b893e2ed" acquired by "delete_volume" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:53 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3d27f5-7c1c-4b1a-8bfb-bd817406320f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:54 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed Sep 17 17:20:54 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (5a628fed-0d6d-467f-b4a6-bcddbe35ce36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2ba52c-5820-4872-85c6-8e5d734ef104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:54 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed" returned: 0 in 0.800s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2ba52c-5820-4872-85c6-8e5d734ef104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1841849651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d00e968-3739-4795-a25f-c057e6c5cd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:55Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11d8198-cb7c-4f65-924f-8c3e43f66064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11d8198-cb7c-4f65-924f-8c3e43f66064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69df4fd-1b0b-4f0f-bee3-2cabe268bede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69df4fd-1b0b-4f0f-bee3-2cabe268bede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d00e968-3739-4795-a25f-c057e6c5cd90', 'volume_name': 'volume-7d00e968-3739-4795-a25f-c057e6c5cd90', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc67fbf-bff3-4f8b-a149-5b30b5624218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:54 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed Sep 17 17:20:54 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc67fbf-bff3-4f8b-a149-5b30b5624218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdb846f-91d5-4a70-872a-cce48f645f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:54 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume 7d00e968-3739-4795-a25f-c057e6c5cd90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d00e968-3739-4795-a25f-c057e6c5cd90', 'volume_size': 1} Sep 17 17:20:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:55 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f71b7f1a-6837-473e-aefa-0677b893e2ed" returned: 0 in 0.535s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-f71b7f1a-6837-473e-aefa-0677b893e2ed" released by "delete_volume" :: held 1.475s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Created reservations ['069e7dac-32e1-48bd-abed-7e9c11a2342c', '78f5442c-5055-4a7e-b733-c7b8227f0904', '2a1d6d2d-2eb1-46fb-b1bd-066bc0ba4799', 'a854eeff-94eb-450b-a66e-0cffa7ecbc25'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:55 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:55 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:55 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586" returned: 0 in 9.197s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d, size 1024.00 MB, duration 9.20 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:20:55 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Converted 1024.00 MB image at 111.32 MB/s Sep 17 17:20:55 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 is being set with open permissions: ugo+rw Sep 17 17:20:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:56 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:56 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 Sep 17 17:20:56 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-88d0b787-ecc1-4aac-9973-3fd14547173d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.501s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Deleted volume successfully. Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-88d0b787-ecc1-4aac-9973-3fd14547173d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d2e63220-be8b-4249-8fac-3ec8aa0690d5 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-f71b7f1a-6837-473e-aefa-0677b893e2ed-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-quobyte-88d0b787-ecc1-4aac-9973-3fd14547173d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-88d0b787-ecc1-4aac-9973-3fd14547173d" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabe13bd-b828-4d48-945c-2d367fbd71a5]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:56 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d Sep 17 17:20:56 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:56 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586" returned: 0 in 0.346s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-8a0424ca-4b15-4692-9ed3-48f2569e6586" released by "_copy_volume_from_snapshot" :: held 10.750s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-0819f549-69c2-4bbc-b85e-fa7d025957c1-8a0424ca-4b15-4692-9ed3-48f2569e6586" released by "_create_volume_from_snapshot" :: held 10.868s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.947s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.609s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1841849651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d00e968-3739-4795-a25f-c057e6c5cd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:55Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Creating volume 7d00e968-3739-4795-a25f-c057e6c5cd90 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:56 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:56 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90 1073741824 Sep 17 17:20:56 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdcc40b-1975-492c-b193-a4ae9470e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0424ca-4b15-4692-9ed3-48f2569e6586', 'volume_size': 1, 'snapshot_id': '0819f549-69c2-4bbc-b85e-fa7d025957c1'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd59946a-d618-4ef7-9ce3-d90481cf3b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Flow 'volume_create_manager' (98cd6ec4-dd94-42bd-bf1a-5215da88a164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4497620-12d1-480a-bf73-723b8efece41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:56 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Volume volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 (8a0424ca-4b15-4692-9ed3-48f2569e6586): created successfully Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd59946a-d618-4ef7-9ce3-d90481cf3b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Flow 'volume_create_manager' (5be23776-d277-498d-8c38-537bcc50030b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4497620-12d1-480a-bf73-723b8efece41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b918c9-f0d7-4c4a-bce3-f67849d3e8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445432a6d3394cc18ef78e58703a0f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:56Z,use_quota=True,user_id='4d5faf7362be4b649c91cbf34118d89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0223017e-f2ba-4db6-a9ce-df7b7a9de570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0223017e-f2ba-4db6-a9ce-df7b7a9de570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659dabc6-ab40-4b24-8caa-04bca3756f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.image.glance [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Creating Keystone auth plugin from conf {{(pid=85889) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 17:20:56 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-acbf4e99-b9dc-4045-86dc-40ca340d8da2 tempest-VolumeDependencyTests-1074931634 None] Created volume successfully. Sep 17 17:20:56 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d" returned: 0 in 0.419s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:56 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d Sep 17 17:20:56 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659dabc6-ab40-4b24-8caa-04bca3756f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '91b918c9-f0d7-4c4a-bce3-f67849d3e8fe', 'volume_name': 'volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe', 'volume_size': 1, 'image_id': '658fe332-8f84-40ae-a393-5cef58cd6b57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/658fe332-8f84-40ae-a393-5cef58cd6b57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'caf98042b8bc6323b00396aedad116de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '445432a6d3394cc18ef78e58703a0f0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf67d4be83c07df76e4c850070ad43dae1ca14c6a37a47f99399b5aab1b60a5438cd6fe4c6db0089dbee5698897cabd93af736161eb94c3bf942f5f24564037f', 'id': '658fe332-8f84-40ae-a393-5cef58cd6b57', 'created_at': datetime.datetime(2026, 9, 17, 15, 20, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 20, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/658fe332-8f84-40ae-a393-5cef58cd6b57/file', 'properties': {}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e9ebca-e642-4f52-a02d-863dced4a0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e9ebca-e642-4f52-a02d-863dced4a0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85191dfb-ffd5-4a0f-9abb-6091824db171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:56 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Volume 91b918c9-f0d7-4c4a-bce3-f67849d3e8fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe', 'volume_size': 1, 'image_id': '658fe332-8f84-40ae-a393-5cef58cd6b57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/658fe332-8f84-40ae-a393-5cef58cd6b57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'caf98042b8bc6323b00396aedad116de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '445432a6d3394cc18ef78e58703a0f0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf67d4be83c07df76e4c850070ad43dae1ca14c6a37a47f99399b5aab1b60a5438cd6fe4c6db0089dbee5698897cabd93af736161eb94c3bf942f5f24564037f', 'id': '658fe332-8f84-40ae-a393-5cef58cd6b57', 'created_at': datetime.datetime(2026, 9, 17, 15, 20, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 20, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/658fe332-8f84-40ae-a393-5cef58cd6b57/file', 'properties': {}}, 'image_service': } Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Trying to clone 91b918c9-f0d7-4c4a-bce3-f67849d3e8fe from image 658fe332-8f84-40ae-a393-5cef58cd6b57 at location (None, [{'url': 'file:///opt/stack/data/glance/images/658fe332-8f84-40ae-a393-5cef58cd6b57', 'metadata': {}}]). {{(pid=85889) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 17:20:56 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d0b787-ecc1-4aac-9973-3fd14547173d" returned: 0 in 0.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-88d0b787-ecc1-4aac-9973-3fd14547173d" released by "delete_volume" :: held 0.753s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:56 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90 1073741824" returned: 0 in 0.492s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 17:20:56 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Image download 0.00 MB at 0.00 MB/s Sep 17 17:20:56 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90 Sep 17 17:20:56 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:56 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Created reservations ['7fd44334-44fb-4174-8cdd-f17dd9240947', '19b3011e-7605-46ca-b8ca-48ff7bcd5ad5', '73c9a3f6-ada0-4270-8004-c42c93b5ac00', '8cabc9a9-e367-45fd-832f-ea2a14070a6f'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e237a3-d1a4-4504-8431-58df8a35adea]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:57 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:20:57 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:57 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD Sep 17 17:20:57 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:57 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90" returned: 0 in 0.287s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-41ca34a5-8af6-4881-ae69-342618c0ac5c-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdb846f-91d5-4a70-872a-cce48f645f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d00e968-3739-4795-a25f-c057e6c5cd90', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db182124-f659-4b63-9a0c-f279ffe879bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-41ca34a5-8af6-4881-ae69-342618c0ac5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-quobyte-b48c2e3a-d889-4bf8-b547-be7304255fbb" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:57 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume volume-7d00e968-3739-4795-a25f-c057e6c5cd90 (7d00e968-3739-4795-a25f-c057e6c5cd90): created successfully Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db182124-f659-4b63-9a0c-f279ffe879bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (5a628fed-0d6d-467f-b4a6-bcddbe35ce36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-b48c2e3a-d889-4bf8-b547-be7304255fbb" acquired by "delete_snapshot" :: waited 0.038s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-quobyte-41ca34a5-8af6-4881-ae69-342618c0ac5c" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:57 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-69383aa0-ffe7-4f71-adcd-14c2e2687171 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created volume successfully. Sep 17 17:20:57 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-41ca34a5-8af6-4881-ae69-342618c0ac5c" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Deleting offline snapshot 41ca34a5-8af6-4881-ae69-342618c0ac5c of volume b48c2e3a-d889-4bf8-b547-be7304255fbb {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:20:57 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] snapshot_file for this snap is: volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.374s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[437f807f-9b43-4d1d-a1ef-c65449fcc339]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:57 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Deleted volume successfully. Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-c1bc8080-a2a9-498f-9a98-acf9d597b033 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-88d0b787-ecc1-4aac-9973-3fd14547173d-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "cinder-0819f549-69c2-4bbc-b85e-fa7d025957c1-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:57 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c Sep 17 17:20:57 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:57 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD Sep 17 17:20:57 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-0819f549-69c2-4bbc-b85e-fa7d025957c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "cinder-quobyte-905ab239-eabf-4206-be96-d8c8345b831d" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-905ab239-eabf-4206-be96-d8c8345b831d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "cinder-quobyte-0819f549-69c2-4bbc-b85e-fa7d025957c1" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-0819f549-69c2-4bbc-b85e-fa7d025957c1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Deleting offline snapshot 0819f549-69c2-4bbc-b85e-fa7d025957c1 of volume 905ab239-eabf-4206-be96-d8c8345b831d {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] snapshot_file for this snap is: volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff10a3-152a-4c44-9980-bb30d43f867d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:57 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:57 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Temporary image 658fe332-8f84-40ae-a393-5cef58cd6b57 is fetched for user 4d5faf7362be4b649c91cbf34118d89e. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 17:20:57 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:57 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c" returned: 0 in 0.415s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48c2e3a-d889-4bf8-b547-be7304255fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ae549f-1ba6-4a19-9b73-76cdc74c1ef8]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7034534a-4320-4200-be83-affee25412c5]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:58 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb Sep 17 17:20:58 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:58 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD Sep 17 17:20:58 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:58 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1" returned: 0 in 0.537s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905ab239-eabf-4206-be96-d8c8345b831d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[206b6407-383d-4825-816e-1e6a2d31214b]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (dabb6c5b-53d5-4150-9a8f-72680f613f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956faf0c-893a-4b83-9955-e680e6fe9887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956faf0c-893a-4b83-9955-e680e6fe9887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746845671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572cbd88-cfdf-45b5-833e-3222802cabd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:58Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7893f5bf-8e42-4efc-88df-6288ab850bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:58 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d Sep 17 17:20:58 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7893f5bf-8e42-4efc-88df-6288ab850bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7692a576-1d7b-4cc3-b61e-fc8c5b5a762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7692a576-1d7b-4cc3-b61e-fc8c5b5a762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572cbd88-cfdf-45b5-833e-3222802cabd0', 'volume_name': 'volume-572cbd88-cfdf-45b5-833e-3222802cabd0', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:58 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc457d8-9182-49b8-925c-a322d18cf656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:58 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc457d8-9182-49b8-925c-a322d18cf656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a124d262-7241-4f26-9879-2996de6c1178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:58 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume 572cbd88-cfdf-45b5-833e-3222802cabd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572cbd88-cfdf-45b5-833e-3222802cabd0', 'volume_size': 1} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746845671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572cbd88-cfdf-45b5-833e-3222802cabd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:58Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Creating volume 572cbd88-cfdf-45b5-833e-3222802cabd0 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:58 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb" returned: 0 in 0.631s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:58 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0 1073741824 Sep 17 17:20:58 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:58 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c Sep 17 17:20:58 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:58 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD Sep 17 17:20:58 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (3f2f723e-9b44-4580-a0b2-145a6e3b5d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3da3ba7-8fa5-433a-934f-e212eb540c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3da3ba7-8fa5-433a-934f-e212eb540c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-167195967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0680ee7a-bfc1-48b7-953b-88d8148290a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:59Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9c67e2-c9c7-4fca-8b61-8871448d7c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9c67e2-c9c7-4fca-8b61-8871448d7c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba74bcfc-8c40-4037-b967-93452ad0b345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba74bcfc-8c40-4037-b967-93452ad0b345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0680ee7a-bfc1-48b7-953b-88d8148290a1', 'volume_name': 'volume-0680ee7a-bfc1-48b7-953b-88d8148290a1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d59b10-6ace-4c5f-b8d5-77cda26bb36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d59b10-6ace-4c5f-b8d5-77cda26bb36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856a0082-06c7-4ac6-b9e8-790f55b23f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume 0680ee7a-bfc1-48b7-953b-88d8148290a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0680ee7a-bfc1-48b7-953b-88d8148290a1', 'volume_size': 1} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:59 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c" returned: 0 in 0.626s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:59 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d" returned: 0 in 0.909s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:59 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c Sep 17 17:20:59 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:59 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD" returned: 1 in 0.706s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:59 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 Sep 17 17:20:59 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:59 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0 1073741824" returned: 0 in 0.770s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (a75315b4-6445-4cf6-9432-6cd33ff2183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0733b3d-77f2-46dc-a293-e85133fbfb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0733b3d-77f2-46dc-a293-e85133fbfb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-544237067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a713a68-a910-47e1-ba6b-bbefb9815048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:59Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc56803c-7555-485f-bef7-1eb1d17143e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc56803c-7555-485f-bef7-1eb1d17143e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:59 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0 Sep 17 17:20:59 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d57759-aef6-4b23-acf9-b1cd4e5a1f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d57759-aef6-4b23-acf9-b1cd4e5a1f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a713a68-a910-47e1-ba6b-bbefb9815048', 'volume_name': 'volume-0a713a68-a910-47e1-ba6b-bbefb9815048', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84898c2b-9641-4c7a-a12f-00f767f1ca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84898c2b-9641-4c7a-a12f-00f767f1ca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4dbe832-38b9-41d8-92f5-9e618831d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume 0a713a68-a910-47e1-ba6b-bbefb9815048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a713a68-a910-47e1-ba6b-bbefb9815048', 'volume_size': 1} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:59 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb.41ca34a5-8af6-4881-ae69-342618c0ac5c" returned: 0 in 0.369s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-41ca34a5-8af6-4881-ae69-342618c0ac5c" released by "_delete_snapshot" :: held 2.229s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-b48c2e3a-d889-4bf8-b547-be7304255fbb" released by "delete_snapshot" :: held 2.323s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:59 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1" returned: 0 in 0.474s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Created reservations ['dc4ce78a-1d4f-4351-bac9-7ebe7d740dcf', '62270605-93f2-4ba3-a23b-500c53c09a12', '32f16a86-ad93-44a2-92c3-d6c6b699008b', 'd2b79d09-12df-46c3-a584-6d530a2145f7'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:20:59 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1 Sep 17 17:20:59 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:59 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0" returned: 0 in 0.432s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-167195967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0680ee7a-bfc1-48b7-953b-88d8148290a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:59Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Creating volume 0680ee7a-bfc1-48b7-953b-88d8148290a1 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:20:59 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:20:59 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1 1073741824 Sep 17 17:20:59 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:20:59 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Delete snapshot completed successfully. Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a124d262-7241-4f26-9879-2996de6c1178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572cbd88-cfdf-45b5-833e-3222802cabd0', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d7fef9-1145-4411-a848-af0a1dc94814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1be243c3-df57-4720-baca-6d2fa73f4fe2 tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-41ca34a5-8af6-4881-ae69-342618c0ac5c-delete_snapshot" released by "delete_snapshot" :: held 2.659s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:20:59 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume volume-572cbd88-cfdf-45b5-833e-3222802cabd0 (572cbd88-cfdf-45b5-833e-3222802cabd0): created successfully Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d7fef9-1145-4411-a848-af0a1dc94814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:20:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (dabb6c5b-53d5-4150-9a8f-72680f613f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (5065d295-4c84-41c7-ab4c-1fbeefa069dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b5bf71-dae2-49be-8d0a-37bc791c9a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4a9c2edf-9c05-4b75-abc1-574e4037c23d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created volume successfully. Sep 17 17:21:00 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d.0819f549-69c2-4bbc-b85e-fa7d025957c1" returned: 0 in 0.320s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b5bf71-dae2-49be-8d0a-37bc791c9a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-763012442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd6416c-ecb5-4a1c-8f71-d6da6d57e816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:00Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35055877-79f6-4884-9ecf-b00e9a3bcdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35055877-79f6-4884-9ecf-b00e9a3bcdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6b25f2-6d59-48ed-aca4-251f015951bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6b25f2-6d59-48ed-aca4-251f015951bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd6416c-ecb5-4a1c-8f71-d6da6d57e816', 'volume_name': 'volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105ecdca-fe74-4aac-b0fd-19f4ceff6fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105ecdca-fe74-4aac-b0fd-19f4ceff6fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22345649-c98f-4883-9322-e2fae3d9697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume 2dd6416c-ecb5-4a1c-8f71-d6da6d57e816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816', 'volume_size': 1} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-0819f549-69c2-4bbc-b85e-fa7d025957c1" released by "_delete_snapshot" :: held 2.465s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-905ab239-eabf-4206-be96-d8c8345b831d" released by "delete_snapshot" :: held 2.500s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Created reservations ['12356e4e-9468-4a1e-8088-337cbbec95c7', 'fdcc6b2c-d8c1-474f-9dc5-5b162815e8f9', 'a6ebc649-e6f1-4fa0-8f93-0b5dc10efa55', '898e1cc0-a1d5-463b-8ed1-21d80fb91b83'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:00 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Delete snapshot completed successfully. Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-03c7a399-6c4b-4d1f-8893-e1ed77bf0817 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-0819f549-69c2-4bbc-b85e-fa7d025957c1-delete_snapshot" released by "delete_snapshot" :: held 2.682s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (07349eaa-5696-4c89-86d6-e0067b07a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f32a3e1-49c0-49ad-a979-ea6c508dff74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f32a3e1-49c0-49ad-a979-ea6c508dff74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668097341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd143f6a-4c72-4595-8bc8-e0c9e279191c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:00Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5522d6d1-11d3-47e9-a94a-bf4d047fae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5522d6d1-11d3-47e9-a94a-bf4d047fae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9a10b2-b3ff-48a5-9f84-18bcc4bbf2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9a10b2-b3ff-48a5-9f84-18bcc4bbf2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd143f6a-4c72-4595-8bc8-e0c9e279191c', 'volume_name': 'volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b04ffa-cc52-4e21-9af1-e56197ea73f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b04ffa-cc52-4e21-9af1-e56197ea73f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b621cab-e07e-4e1c-a17e-8bb838762aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume dd143f6a-4c72-4595-8bc8-e0c9e279191c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c', 'volume_size': 1} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:00 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1 1073741824" returned: 0 in 0.559s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:00 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1 Sep 17 17:21:00 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-b48c2e3a-d889-4bf8-b547-be7304255fbb-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-b48c2e3a-d889-4bf8-b547-be7304255fbb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "cinder-quobyte-b48c2e3a-d889-4bf8-b547-be7304255fbb" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-b48c2e3a-d889-4bf8-b547-be7304255fbb" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b514f7-c42b-4d94-a2a6-6ab27761aed9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:00 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1" returned: 0 in 0.287s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:00 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb Sep 17 17:21:00 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b918c9-f0d7-4c4a-bce3-f67849d3e8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445432a6d3394cc18ef78e58703a0f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:56Z,use_quota=True,user_id='4d5faf7362be4b649c91cbf34118d89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Creating volume 91b918c9-f0d7-4c4a-bce3-f67849d3e8fe {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:00 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856a0082-06c7-4ac6-b9e8-790f55b23f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0680ee7a-bfc1-48b7-953b-88d8148290a1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67da4845-f166-4180-9324-d55b1459e3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:00 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe 1073741824 Sep 17 17:21:00 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:00 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume volume-0680ee7a-bfc1-48b7-953b-88d8148290a1 (0680ee7a-bfc1-48b7-953b-88d8148290a1): created successfully Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67da4845-f166-4180-9324-d55b1459e3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (3f2f723e-9b44-4580-a0b2-145a6e3b5d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:00 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-26f372a7-89a0-454f-a495-e963ecb62ea3 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created volume successfully. Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "cinder-905ab239-eabf-4206-be96-d8c8345b831d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-905ab239-eabf-4206-be96-d8c8345b831d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "cinder-quobyte-905ab239-eabf-4206-be96-d8c8345b831d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-905ab239-eabf-4206-be96-d8c8345b831d" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a086390-4d91-4b0a-b0df-13c9c78de6bf]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:01 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb" returned: 0 in 0.420s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:01 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb Sep 17 17:21:01 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:01 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d Sep 17 17:21:01 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:01 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe 1073741824" returned: 0 in 0.512s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:01 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe Sep 17 17:21:01 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:01 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b48c2e3a-d889-4bf8-b547-be7304255fbb" returned: 0 in 0.317s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-quobyte-b48c2e3a-d889-4bf8-b547-be7304255fbb" released by "delete_volume" :: held 0.813s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:01 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Created reservations ['47089588-2f91-44f6-8389-dbfc03487c34', 'ec4fa265-8e6c-43e1-9a97-41048033d6ad', '0f1a255c-c78e-48e5-b75b-5b3c6c2f4d56', '8ad173b7-a350-4222-8706-8b564436c636'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d" returned: 0 in 0.415s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:01 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d Sep 17 17:21:01 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:01 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:01 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:01 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe" returned: 0 in 0.318s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.133s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-544237067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a713a68-a910-47e1-ba6b-bbefb9815048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:20:59Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Creating volume 0a713a68-a910-47e1-ba6b-bbefb9815048 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:01 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:01 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048 1073741824 Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Attempting download of 658fe332-8f84-40ae-a393-5cef58cd6b57 ((None, [{'url': 'file:///opt/stack/data/glance/images/658fe332-8f84-40ae-a393-5cef58cd6b57', 'metadata': {}}])) to volume 91b918c9-f0d7-4c4a-bce3-f67849d3e8fe. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 17:21:01 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:01 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-905ab239-eabf-4206-be96-d8c8345b831d" returned: 0 in 0.333s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c72b65-83cd-4f45-bf57-39e0f6c3cc93]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_658fe332-8f84-40ae-a393-5cef58cd6b57_j51k_d8a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-905ab239-eabf-4206-be96-d8c8345b831d" released by "delete_volume" :: held 0.836s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:01 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.348s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:01 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Deleted volume successfully. Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Created reservations ['732df7e2-45dc-4057-b4cf-6bd8e46ada18', '40188c1a-d525-4159-9a39-f388ca0ad8da', '4bc2d48d-e7e7-4925-9525-7e4e5a7c27e9', '2dec4418-fab6-4e58-92d5-5ff82719833e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-12495d5d-c85b-4c12-bd62-6feb2ef27ada tempest-CreateVolumesFromSnapshotTest-183439184 None] Lock "cinder-b48c2e3a-d889-4bf8-b547-be7304255fbb-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:02 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_658fe332-8f84-40ae-a393-5cef58cd6b57_j51k_d8a Sep 17 17:21:02 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:02 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "cinder-8a0424ca-4b15-4692-9ed3-48f2569e6586-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:02 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-8a0424ca-4b15-4692-9ed3-48f2569e6586-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "cinder-quobyte-8a0424ca-4b15-4692-9ed3-48f2569e6586" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:02 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_658fe332-8f84-40ae-a393-5cef58cd6b57_j51k_d8a" returned: 0 in 0.506s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_658fe332-8f84-40ae-a393-5cef58cd6b57_j51k_d8a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-8a0424ca-4b15-4692-9ed3-48f2569e6586" acquired by "delete_volume" :: waited 0.049s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbe985b-fece-451d-92cd-ca8f46a1ecc5]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:02 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048 1073741824" returned: 0 in 0.773s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:02 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048 Sep 17 17:21:02 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:02 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.507s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Deleted volume successfully. Sep 17 17:21:02 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_658fe332-8f84-40ae-a393-5cef58cd6b57_j51k_d8a Sep 17 17:21:02 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d9e8b57-7d14-4d2f-859c-865c7c6f618f tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-905ab239-eabf-4206-be96-d8c8345b831d-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:02 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 Sep 17 17:21:02 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:02 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_658fe332-8f84-40ae-a393-5cef58cd6b57_j51k_d8a" returned: 1 in 0.603s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_658fe332-8f84-40ae-a393-5cef58cd6b57_j51k_d8a' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaed081-7c54-484c-9bed-f36b57ffc8f3]: (4, 'raw') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:02 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048" returned: 0 in 0.475s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:02 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.869s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-763012442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd6416c-ecb5-4a1c-8f71-d6da6d57e816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:00Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Creating volume 2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:03 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586" returned: 0 in 0.596s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:03 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 1073741824 Sep 17 17:21:03 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4dbe832-38b9-41d8-92f5-9e618831d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a713a68-a910-47e1-ba6b-bbefb9815048', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38286f9-0137-42c4-801c-a8f9254e66a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:03 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586 Sep 17 17:21:03 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:03 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume volume-0a713a68-a910-47e1-ba6b-bbefb9815048 (0a713a68-a910-47e1-ba6b-bbefb9815048): created successfully Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38286f9-0137-42c4-801c-a8f9254e66a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:03 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD Sep 17 17:21:03 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (a75315b4-6445-4cf6-9432-6cd33ff2183e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:03 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f9b08436-ff82-430f-81cc-1db0a1033b4d tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created volume successfully. Sep 17 17:21:03 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-8a0424ca-4b15-4692-9ed3-48f2569e6586" returned: 0 in 0.320s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:03 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-quobyte-8a0424ca-4b15-4692-9ed3-48f2569e6586" released by "delete_volume" :: held 0.990s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Created reservations ['0fd5a611-ccc7-48da-9d71-d018d133e741', 'f101e9c9-0558-4e82-bc6d-cd7d0eb3b989', '86b44e1a-a7d9-4132-a201-c60b1c4dc5f1', '15000f4a-ab39-4e6e-b796-05af038c36f5'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:03 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD Sep 17 17:21:03 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:03 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:03 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:03 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 1073741824" returned: 0 in 0.626s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:03 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 Sep 17 17:21:03 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:03 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD" returned: 1 in 0.437s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD' failed. Not Retrying. {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] 658fe332-8f84-40ae-a393-5cef58cd6b57 was raw, converting to qcow2 {{(pid=85889) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:03 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe Sep 17 17:21:03 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:03 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.330s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:03 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Deleted volume successfully. Sep 17 17:21:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dfc1533a-6029-4713-b74f-9a7709325768 tempest-VolumeDependencyTests-1074931634 None] Lock "cinder-8a0424ca-4b15-4692-9ed3-48f2569e6586-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:04 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.605s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668097341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd143f6a-4c72-4595-8bc8-e0c9e279191c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8796927c25d4e5eabbce40d51f98c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:00Z,use_quota=True,user_id='bec6b0a21cfc4964ad139a8ca139309c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Creating volume dd143f6a-4c72-4595-8bc8-e0c9e279191c {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:04 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22345649-c98f-4883-9322-e2fae3d9697d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8f91e3-5d1c-458f-a6f1-e0b085098a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:04 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c 1073741824 Sep 17 17:21:04 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:04 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 (2dd6416c-ecb5-4a1c-8f71-d6da6d57e816): created successfully Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8f91e3-5d1c-458f-a6f1-e0b085098a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (5065d295-4c84-41c7-ab4c-1fbeefa069dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e33b0e07-a144-415b-870d-4948997a0835 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created volume successfully. Sep 17 17:21:04 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe" returned: 0 in 0.538s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_658fe332-8f84-40ae-a393-5cef58cd6b57_p1p3cohedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:21:04 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:04 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe 1G Sep 17 17:21:04 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:04 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c 1073741824" returned: 0 in 0.555s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:04 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c Sep 17 17:21:04 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:04 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe 1G" returned: 0 in 0.382s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Downloaded image 658fe332-8f84-40ae-a393-5cef58cd6b57 ((None, [{'url': 'file:///opt/stack/data/glance/images/658fe332-8f84-40ae-a393-5cef58cd6b57', 'metadata': {}}])) to volume 91b918c9-f0d7-4c4a-bce3-f67849d3e8fe successfully. {{(pid=85889) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Temporary image 658fe332-8f84-40ae-a393-5cef58cd6b57 for user 4d5faf7362be4b649c91cbf34118d89e is deleted. {{(pid=85889) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.volume_utils [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Marking volume 91b918c9-f0d7-4c4a-bce3-f67849d3e8fe as bootable. {{(pid=85889) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Copying metadata from image 658fe332-8f84-40ae-a393-5cef58cd6b57 to 91b918c9-f0d7-4c4a-bce3-f67849d3e8fe. {{(pid=85889) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Creating volume glance metadata for volume 91b918c9-f0d7-4c4a-bce3-f67849d3e8fe backed by image 658fe332-8f84-40ae-a393-5cef58cd6b57 with: {'image_id': '658fe332-8f84-40ae-a393-5cef58cd6b57', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'caf98042b8bc6323b00396aedad116de', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85889) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85191dfb-ffd5-4a0f-9abb-6091824db171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe', 'volume_size': 1, 'image_id': '658fe332-8f84-40ae-a393-5cef58cd6b57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/658fe332-8f84-40ae-a393-5cef58cd6b57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'caf98042b8bc6323b00396aedad116de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '445432a6d3394cc18ef78e58703a0f0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf67d4be83c07df76e4c850070ad43dae1ca14c6a37a47f99399b5aab1b60a5438cd6fe4c6db0089dbee5698897cabd93af736161eb94c3bf942f5f24564037f', 'id': '658fe332-8f84-40ae-a393-5cef58cd6b57', 'created_at': datetime.datetime(2026, 9, 17, 15, 20, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 15, 20, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/658fe332-8f84-40ae-a393-5cef58cd6b57/file', 'properties': {}}, 'image_service': }' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b577a2-be0b-4498-94ff-45874e28e37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:04 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Volume volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe (91b918c9-f0d7-4c4a-bce3-f67849d3e8fe): created successfully Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b577a2-be0b-4498-94ff-45874e28e37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Flow 'volume_create_manager' (98cd6ec4-dd94-42bd-bf1a-5215da88a164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-77ef5a70-eb6a-447f-806b-b1652ab9afde tempest-VolumeImageDependencyTests-806809727 None] Created volume successfully. Sep 17 17:21:04 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c" returned: 0 in 0.332s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b621cab-e07e-4e1c-a17e-8bb838762aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dff220d-aecb-4807-87aa-62176403d910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:05 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Volume volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c (dd143f6a-4c72-4595-8bc8-e0c9e279191c): created successfully Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dff220d-aecb-4807-87aa-62176403d910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Flow 'volume_create_manager' (07349eaa-5696-4c89-86d6-e0067b07a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:05 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4b02cc82-bd4f-44b5-95d2-6e036c7f1463 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created volume successfully. Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Acquiring lock "cinder-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Lock "cinder-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Acquiring lock "cinder-quobyte-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Lock "cinder-quobyte-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2349dc-3365-4ffd-a28a-ebf5ecd4ca9c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:05 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe Sep 17 17:21:05 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:05 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe" returned: 0 in 0.455s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:05 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe Sep 17 17:21:05 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:06 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe" returned: 0 in 0.297s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Lock "cinder-quobyte-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe" released by "delete_volume" :: held 0.814s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Created reservations ['c9de3b89-a26a-453b-883e-27917215214f', '6fc4cb5c-33aa-4063-8dfb-0eca91a560f7', '95d80255-1c08-48db-afd8-2748463ff8a2', '90c85c1a-c57c-43f0-9897-9e248143b65b'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-dd143f6a-4c72-4595-8bc8-e0c9e279191c-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-dd143f6a-4c72-4595-8bc8-e0c9e279191c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-quobyte-dd143f6a-4c72-4595-8bc8-e0c9e279191c" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-dd143f6a-4c72-4595-8bc8-e0c9e279191c" acquired by "delete_volume" :: waited 0.054s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:06 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:06 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[111f11e0-d4bc-47c3-98df-164a1a1ba905]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:06 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c Sep 17 17:21:06 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:06 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.369s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:06 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Deleted volume successfully. Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-dbd35130-5a47-43c3-856e-d097dee9c173 tempest-VolumeImageDependencyTests-806809727 None] Lock "cinder-91b918c9-f0d7-4c4a-bce3-f67849d3e8fe-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:06 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c" returned: 0 in 0.530s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:06 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c Sep 17 17:21:06 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:07 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dd143f6a-4c72-4595-8bc8-e0c9e279191c" returned: 0 in 0.307s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-dd143f6a-4c72-4595-8bc8-e0c9e279191c" released by "delete_volume" :: held 0.896s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created reservations ['0cfbbb48-1ab2-4413-942d-c69828fa0d45', '121d2bd4-2a98-46d6-80ff-3f9cf1ae4453', 'f83f9543-5be8-437b-ac70-35980c5840bd', 'c3a7772a-4d24-405d-9ff3-79b5d35d89d6'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:07 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:07 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:07 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.303s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Deleted volume successfully. Sep 17 17:21:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f2336a97-5ce2-460f-b72d-533515bb297f tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-dd143f6a-4c72-4595-8bc8-e0c9e279191c-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-quobyte-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816" acquired by "delete_volume" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:08 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15dab5e-9438-4681-a64d-10c3b739dce1]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:08 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 Sep 17 17:21:08 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:09 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816" returned: 0 in 0.486s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:09 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816 Sep 17 17:21:09 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Flow 'volume_create_manager' (4a4fb196-45a6-45ba-823d-1c3346710e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af68a18-2d74-4eb3-b70f-04ec61b272db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af68a18-2d74-4eb3-b70f-04ec61b272db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92d0b5c-b9fd-4ce1-b89a-c693d77d958f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7c36b46729475686df1425c0c4a9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:09Z,use_quota=True,user_id='30fe730a3ecc4552a91e0c4a11cf7201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08799c7-878d-4acc-97a8-866cf1a5943a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08799c7-878d-4acc-97a8-866cf1a5943a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d2e743-6936-48ae-8c6f-0600cc9477ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d2e743-6936-48ae-8c6f-0600cc9477ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c92d0b5c-b9fd-4ce1-b89a-c693d77d958f', 'volume_name': 'volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28293c67-9484-4ff6-9a9c-c9d5581d6616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28293c67-9484-4ff6-9a9c-c9d5581d6616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92fd8e5b-83df-408a-898d-f17a59c7215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:09 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Volume c92d0b5c-b9fd-4ce1-b89a-c693d77d958f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f', 'volume_size': 1} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92d0b5c-b9fd-4ce1-b89a-c693d77d958f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7c36b46729475686df1425c0c4a9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:09Z,use_quota=True,user_id='30fe730a3ecc4552a91e0c4a11cf7201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Creating volume c92d0b5c-b9fd-4ce1-b89a-c693d77d958f {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:09 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:09 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f 1073741824 Sep 17 17:21:09 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:09 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816" returned: 0 in 0.294s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816" released by "delete_volume" :: held 0.847s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created reservations ['3a6005db-0624-4e00-a7d6-810bd1883f82', '7117d7de-3011-4388-bd76-a8ea8ee63bdd', 'f23b44f5-bab6-4689-a02e-47b5439092e5', '7555aad2-ea78-4310-a055-8469d1750dde'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:09 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:09 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-0a713a68-a910-47e1-ba6b-bbefb9815048-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-0a713a68-a910-47e1-ba6b-bbefb9815048-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-quobyte-0a713a68-a910-47e1-ba6b-bbefb9815048" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-0a713a68-a910-47e1-ba6b-bbefb9815048" acquired by "delete_volume" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb20501-1eb6-4cbf-9b4a-8b74bc048079]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:09 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f 1073741824" returned: 0 in 0.636s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:10 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.385s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Deleted volume successfully. Sep 17 17:21:10 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f Sep 17 17:21:10 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d321a74f-9033-4a30-8efb-e14581346f12 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-2dd6416c-ecb5-4a1c-8f71-d6da6d57e816-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:10 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048 Sep 17 17:21:10 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:10 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048" returned: 0 in 0.473s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:10 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f" returned: 0 in 0.376s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92fd8e5b-83df-408a-898d-f17a59c7215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:10 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048 Sep 17 17:21:10 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877c094e-739b-4963-944a-0b92484ddb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:10 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Volume volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f (c92d0b5c-b9fd-4ce1-b89a-c693d77d958f): created successfully Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877c094e-739b-4963-944a-0b92484ddb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Flow 'volume_create_manager' (4a4fb196-45a6-45ba-823d-1c3346710e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-296150be-5716-4f75-b709-2f8c7d25724c tempest-CinderUnicodeTest-1574911927 None] Created volume successfully. Sep 17 17:21:10 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0a713a68-a910-47e1-ba6b-bbefb9815048" returned: 0 in 0.275s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-0a713a68-a910-47e1-ba6b-bbefb9815048" released by "delete_volume" :: held 0.809s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created reservations ['e7b853a8-e20c-4809-b157-2e3f39fe3575', 'f09e2198-92f1-404f-86d9-901af3abcf5b', '9c757165-6368-43ad-a912-c0b333d5159b', '09a08670-b703-4788-af2a-c448265abb3c'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:10 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:10 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-0680ee7a-bfc1-48b7-953b-88d8148290a1-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-0680ee7a-bfc1-48b7-953b-88d8148290a1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-quobyte-0680ee7a-bfc1-48b7-953b-88d8148290a1" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-0680ee7a-bfc1-48b7-953b-88d8148290a1" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:11 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.317s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:11 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Deleted volume successfully. Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[962f13be-ca5c-4ad7-a9c1-52b3588ee8d0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f5c126a0-20cf-42af-a70a-c2a1cbc73e9b tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-0a713a68-a910-47e1-ba6b-bbefb9815048-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b441ae7a-dc7d-4121-b22c-d52619ad9d12 tempest-ProjectAdminTests-1210559975 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.800148010254, 'free_capacity_gb': 1775.800148010254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85889) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 17:21:11 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1 Sep 17 17:21:11 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:11 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1" returned: 0 in 0.511s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:11 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:11 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1 Sep 17 17:21:11 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:12 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0680ee7a-bfc1-48b7-953b-88d8148290a1" returned: 0 in 0.386s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-0680ee7a-bfc1-48b7-953b-88d8148290a1" released by "delete_volume" :: held 0.969s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created reservations ['cc6b44f5-d55c-469c-bb7a-11a4d8545691', '202ba69d-6d2c-4d67-8007-eb0ba8194839', 'f4cb49a2-80ca-4a5a-a28b-181070c316d5', '70e43b11-7f46-4ecd-b39d-7531059acc4a'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Flow 'volume_create_manager' (1511f150-1421-49f8-8941-f8885a91180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8324344-5823-47da-9cb3-8a97261891bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8324344-5823-47da-9cb3-8a97261891bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-979655455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191da864-47f7-49cf-8189-80be1f0b00bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7c36b46729475686df1425c0c4a9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:12Z,use_quota=True,user_id='30fe730a3ecc4552a91e0c4a11cf7201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f58fb9f-cb56-4b54-86dd-990974e83bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f58fb9f-cb56-4b54-86dd-990974e83bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f2a11b-3c80-4c3f-9438-998d8cde3892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f2a11b-3c80-4c3f-9438-998d8cde3892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191da864-47f7-49cf-8189-80be1f0b00bb', 'volume_name': 'volume-191da864-47f7-49cf-8189-80be1f0b00bb', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9227fc0-5d5c-4750-8024-ead2a60832d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9227fc0-5d5c-4750-8024-ead2a60832d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ba4b95-fb44-4a0f-aacf-44c8b3d43097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:12 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Volume 191da864-47f7-49cf-8189-80be1f0b00bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191da864-47f7-49cf-8189-80be1f0b00bb', 'volume_size': 1} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-979655455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191da864-47f7-49cf-8189-80be1f0b00bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7c36b46729475686df1425c0c4a9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:12Z,use_quota=True,user_id='30fe730a3ecc4552a91e0c4a11cf7201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Creating volume 191da864-47f7-49cf-8189-80be1f0b00bb {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:12 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:12 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb 1073741824 Sep 17 17:21:12 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:12 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:12 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:12 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.383s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:12 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Deleted volume successfully. Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-2bf6f136-5ef0-4434-a8e1-c1de7c3ce353 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-0680ee7a-bfc1-48b7-953b-88d8148290a1-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:12 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:12 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb 1073741824" returned: 0 in 0.681s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:13 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb Sep 17 17:21:13 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-572cbd88-cfdf-45b5-833e-3222802cabd0-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:13 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb" returned: 0 in 0.342s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-572cbd88-cfdf-45b5-833e-3222802cabd0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ba4b95-fb44-4a0f-aacf-44c8b3d43097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191da864-47f7-49cf-8189-80be1f0b00bb', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cae82f-61ea-49ad-91f5-15c167347be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:13 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Volume volume-191da864-47f7-49cf-8189-80be1f0b00bb (191da864-47f7-49cf-8189-80be1f0b00bb): created successfully Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cae82f-61ea-49ad-91f5-15c167347be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Flow 'volume_create_manager' (1511f150-1421-49f8-8941-f8885a91180c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-quobyte-572cbd88-cfdf-45b5-833e-3222802cabd0" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f032a5a1-3f30-4bf0-94ff-50468dd4c3c1 tempest-CinderUnicodeTest-1574911927 None] Created volume successfully. Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-572cbd88-cfdf-45b5-833e-3222802cabd0" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5f3b9b-bb70-4ac0-917b-7a61de7fc9b5]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:13 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0 Sep 17 17:21:13 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:13 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0" returned: 0 in 0.430s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:13 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0 Sep 17 17:21:13 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:14 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-572cbd88-cfdf-45b5-833e-3222802cabd0" returned: 0 in 0.251s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-572cbd88-cfdf-45b5-833e-3222802cabd0" released by "delete_volume" :: held 0.733s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created reservations ['eeec05d1-9750-4701-923f-4a81b035fd17', 'a04080de-33c1-4fb5-bdb5-1ca204937abd', '03f6d678-8aec-4847-874b-c1424e5f6bb3', 'c4c7d579-7564-4ccf-8ac6-f02a0683a066'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:14 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:14 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-7d00e968-3739-4795-a25f-c057e6c5cd90-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-7d00e968-3739-4795-a25f-c057e6c5cd90-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Creating offline snapshot c7d177c2-3908-4890-b08e-5834aa29d3b0 of volume 191da864-47f7-49cf-8189-80be1f0b00bb {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "cinder-quobyte-7d00e968-3739-4795-a25f-c057e6c5cd90" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[845dfc2e-b539-4559-af7e-51eb4540e104]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:14 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.312s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-7d00e968-3739-4795-a25f-c057e6c5cd90" acquired by "delete_volume" :: waited 0.039s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:14 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Deleted volume successfully. Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c84e0f0-8739-45bb-8465-d4099d341eb5]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-7b279b3b-1190-4042-babd-06e68a37b9b0 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-572cbd88-cfdf-45b5-833e-3222802cabd0-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:14 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb Sep 17 17:21:14 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:14 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90 Sep 17 17:21:14 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:15 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb" returned: 0 in 0.445s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:15 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 1G Sep 17 17:21:15 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:15 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90" returned: 0 in 0.459s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:15 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90 Sep 17 17:21:15 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:15 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-7d00e968-3739-4795-a25f-c057e6c5cd90" returned: 0 in 0.316s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-quobyte-7d00e968-3739-4795-a25f-c057e6c5cd90" released by "delete_volume" :: held 0.851s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:15 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Created reservations ['572023f4-8c2c-4861-9e07-5536b03b3cd3', '15da8dd3-0c2d-434d-a276-db76fde7156c', 'cbb2b398-2bca-4145-ac4b-660859ed3fa5', '3b54fade-88da-4419-8065-30b407da051f'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 1G" returned: 0 in 0.518s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-191da864-47f7-49cf-8189-80be1f0b00bb -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:15 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-191da864-47f7-49cf-8189-80be1f0b00bb -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 Sep 17 17:21:15 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:15 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:15 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:16 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.337s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:16 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Deleted volume successfully. Sep 17 17:21:16 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-191da864-47f7-49cf-8189-80be1f0b00bb -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0" returned: 0 in 0.530s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:16 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 is being set with open permissions: ugo+rw Sep 17 17:21:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-978a1572-9048-4793-944a-55c956df2e91 tempest-CreateVolumesFromSourceVolumeTest-1979767580 None] Lock "cinder-7d00e968-3739-4795-a25f-c057e6c5cd90-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:16 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 Sep 17 17:21:16 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:16 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0" returned: 0 in 0.260s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:16 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.info Sep 17 17:21:16 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:16 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.info" returned: 0 in 0.280s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:16 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.info is being set with open permissions: ugo+rw Sep 17 17:21:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:16 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.info Sep 17 17:21:16 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:16 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.info" returned: 0 in 0.276s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:17 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-55d191f7-0664-4ced-be79-c49323619cb8 tempest-CinderUnicodeTest-1574911927 None] Create snapshot completed successfully Sep 17 17:21:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "cinder-c7d177c2-3908-4890-b08e-5834aa29d3b0-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-c7d177c2-3908-4890-b08e-5834aa29d3b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "cinder-quobyte-191da864-47f7-49cf-8189-80be1f0b00bb" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-quobyte-191da864-47f7-49cf-8189-80be1f0b00bb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "cinder-quobyte-c7d177c2-3908-4890-b08e-5834aa29d3b0" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-quobyte-c7d177c2-3908-4890-b08e-5834aa29d3b0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Deleting offline snapshot c7d177c2-3908-4890-b08e-5834aa29d3b0 of volume 191da864-47f7-49cf-8189-80be1f0b00bb {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:21:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] snapshot_file for this snap is: volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:21:18 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd3c8c8-f600-46b5-978e-423421a00e4d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:18 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 Sep 17 17:21:18 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:18 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0" returned: 0 in 0.420s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-191da864-47f7-49cf-8189-80be1f0b00bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:21:18 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4a2c5b-35bc-4377-a6b0-c74c236f7908]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:18 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb Sep 17 17:21:18 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:18 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb" returned: 0 in 0.384s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:18 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 Sep 17 17:21:18 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:19 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0" returned: 0 in 0.448s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:19 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0 Sep 17 17:21:19 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:19 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb.c7d177c2-3908-4890-b08e-5834aa29d3b0" returned: 0 in 0.304s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-quobyte-c7d177c2-3908-4890-b08e-5834aa29d3b0" released by "_delete_snapshot" :: held 1.708s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-quobyte-191da864-47f7-49cf-8189-80be1f0b00bb" released by "delete_snapshot" :: held 1.730s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:19 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Created reservations ['40f36905-070f-47c6-95e5-0c2abbb5e4e2', 'f78e923e-3ac9-4017-a0c9-c9666cb47b44', '73e8dfb6-c648-4ef7-9906-640c9ef34e00', '5360a641-d9cb-433d-9c5a-a471493037c7'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Delete snapshot completed successfully. Sep 17 17:21:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4b41c618-311b-4397-a159-6517902749c3 tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-c7d177c2-3908-4890-b08e-5834aa29d3b0-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "cinder-191da864-47f7-49cf-8189-80be1f0b00bb-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-191da864-47f7-49cf-8189-80be1f0b00bb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "cinder-quobyte-191da864-47f7-49cf-8189-80be1f0b00bb" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-quobyte-191da864-47f7-49cf-8189-80be1f0b00bb" acquired by "delete_volume" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:20 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9504a6e3-386b-48e7-a552-52f669e1ea8f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:20 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb Sep 17 17:21:20 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:20 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb" returned: 0 in 0.404s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:20 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb Sep 17 17:21:20 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:20 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-191da864-47f7-49cf-8189-80be1f0b00bb" returned: 0 in 0.297s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-quobyte-191da864-47f7-49cf-8189-80be1f0b00bb" released by "delete_volume" :: held 0.774s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Created reservations ['71a7aca5-a3c3-4be7-9c63-1fcb2441389c', '25331773-a63d-4351-88e1-7fe04a8efe2c', '9dd74085-4e43-4033-b205-3c30cb2c6c7b', '8ad7a172-fe58-41a2-8131-fbe303dfccca'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:21 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:21 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "cinder-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "cinder-quobyte-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-quobyte-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:21 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[442aa544-fcd8-4ed7-aceb-32b6579898ad]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.332s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:21 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Deleted volume successfully. Sep 17 17:21:21 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-9d9cd602-e958-4b20-bc2b-1d7a133d43dc tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-191da864-47f7-49cf-8189-80be1f0b00bb-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:21 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f Sep 17 17:21:21 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:22 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f" returned: 0 in 0.505s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:22 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f Sep 17 17:21:22 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:22 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f" returned: 0 in 0.326s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:22 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-quobyte-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f" released by "delete_volume" :: held 0.914s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:22 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Created reservations ['86ad33cd-947e-48c1-9918-d45480ae012a', '540aefb5-474a-4c10-b153-b0874f42e5df', 'c9d5b0d3-e6cd-489f-b34e-c723e02e7abb', '55fc9c77-ae5e-4860-9b4f-3001f08dfc97'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:22 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:22 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:22 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.394s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:21:22 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.404s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:22 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Deleted volume successfully. Sep 17 17:21:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f9dfe3df-50e4-40dd-8d8f-02e713e01d07 tempest-CinderUnicodeTest-1574911927 None] Lock "cinder-c92d0b5c-b9fd-4ce1-b89a-c693d77d958f-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Flow 'volume_create_manager' (206c908f-2bc6-4bb6-ae89-990053ac9763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86553c8e-5d0f-4acb-a935-2951e11e966d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86553c8e-5d0f-4acb-a935-2951e11e966d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899695587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e61620-8a49-4131-8d10-69a9ada05e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aed13e3e7014a4b9174d97df9d0252c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:26Z,use_quota=True,user_id='7323052241d74855811e5fc415d04c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82cac7af-0441-4699-b8ba-4a927f866408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82cac7af-0441-4699-b8ba-4a927f866408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8330e8-ca98-45c8-968a-0b15b962ac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8330e8-ca98-45c8-968a-0b15b962ac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e61620-8a49-4131-8d10-69a9ada05e36', 'volume_name': 'volume-b9e61620-8a49-4131-8d10-69a9ada05e36', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ca4686-118c-4ca9-96fc-96914e4b2afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ca4686-118c-4ca9-96fc-96914e4b2afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5193b2dd-2afd-4c77-9b2f-791dc5a308bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:26 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Volume b9e61620-8a49-4131-8d10-69a9ada05e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e61620-8a49-4131-8d10-69a9ada05e36', 'volume_size': 1} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899695587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e61620-8a49-4131-8d10-69a9ada05e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aed13e3e7014a4b9174d97df9d0252c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:26Z,use_quota=True,user_id='7323052241d74855811e5fc415d04c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Creating volume b9e61620-8a49-4131-8d10-69a9ada05e36 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:26 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:26 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 1073741824 Sep 17 17:21:26 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:26 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 1073741824" returned: 0 in 0.530s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:26 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 Sep 17 17:21:26 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (a15c9f52-6b61-48d7-83e9-f1f4600b2fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:26 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d33a323-aa8f-4ae3-9c4f-a4cfd11b65f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d33a323-aa8f-4ae3-9c4f-a4cfd11b65f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846448617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c2843a-1500-4467-bc70-fe06bd527c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:27Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faef87c-1a9f-4ddb-a446-fdaaa41d0282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faef87c-1a9f-4ddb-a446-fdaaa41d0282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73be4d05-b7a7-428a-8f80-fe935468d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73be4d05-b7a7-428a-8f80-fe935468d3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c2843a-1500-4467-bc70-fe06bd527c07', 'volume_name': 'volume-88c2843a-1500-4467-bc70-fe06bd527c07', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163a5d22-3d56-4922-830b-82bc269c525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:27 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163a5d22-3d56-4922-830b-82bc269c525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91159d1-14ed-4aa3-a3f0-096c1231d96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:27 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Volume 88c2843a-1500-4467-bc70-fe06bd527c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c2843a-1500-4467-bc70-fe06bd527c07', 'volume_size': 1} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36" returned: 0 in 0.305s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846448617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c2843a-1500-4467-bc70-fe06bd527c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:27Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Creating volume 88c2843a-1500-4467-bc70-fe06bd527c07 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:27 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5193b2dd-2afd-4c77-9b2f-791dc5a308bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e61620-8a49-4131-8d10-69a9ada05e36', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:27 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 1073741824 Sep 17 17:21:27 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d9f906-a20a-42f1-91df-b8ce4dfd3443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:27 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Volume volume-b9e61620-8a49-4131-8d10-69a9ada05e36 (b9e61620-8a49-4131-8d10-69a9ada05e36): created successfully Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d9f906-a20a-42f1-91df-b8ce4dfd3443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Flow 'volume_create_manager' (206c908f-2bc6-4bb6-ae89-990053ac9763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:27 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-15e9c15c-7b06-495a-a397-360005b65eb8 tempest-ProjectReaderTests-835462842 None] Created volume successfully. Sep 17 17:21:27 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 1073741824" returned: 0 in 0.464s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:27 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 Sep 17 17:21:27 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:27 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91159d1-14ed-4aa3-a3f0-096c1231d96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c2843a-1500-4467-bc70-fe06bd527c07', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9045089-9aba-4860-8602-e70a14748d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:27 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Volume volume-88c2843a-1500-4467-bc70-fe06bd527c07 (88c2843a-1500-4467-bc70-fe06bd527c07): created successfully Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9045089-9aba-4860-8602-e70a14748d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:27 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (a15c9f52-6b61-48d7-83e9-f1f4600b2fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:27 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0b64c99d-50d3-4bac-8770-1624d58f3ca0 tempest-ProjectMemberTests-72633776 None] Created volume successfully. Sep 17 17:21:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:28 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Creating offline snapshot dba60f7b-49bd-4178-829d-6fedc0bdbdad of volume b9e61620-8a49-4131-8d10-69a9ada05e36 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:21:28 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae5f08-cb94-4b16-beaa-8c3b21c7d3d1]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:28 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 Sep 17 17:21:28 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:28 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36" returned: 0 in 0.391s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:28 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad 1G Sep 17 17:21:28 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:29 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad 1G" returned: 0 in 0.527s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e61620-8a49-4131-8d10-69a9ada05e36 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:29 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e61620-8a49-4131-8d10-69a9ada05e36 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad Sep 17 17:21:29 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:29 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e61620-8a49-4131-8d10-69a9ada05e36 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad" returned: 0 in 0.356s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:29 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad is being set with open permissions: ugo+rw Sep 17 17:21:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:29 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad Sep 17 17:21:29 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:29 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=280,cinder:SELECT=207,cinder:INSERT=71,cinder:DELETE=26 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:21:29 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=207,cinder:UPDATE=289,cinder:INSERT=80,cinder:DELETE=25 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:21:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:29 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad" returned: 0 in 0.283s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:29 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.info Sep 17 17:21:29 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:30 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.info" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:30 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.info is being set with open permissions: ugo+rw Sep 17 17:21:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:30 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.info Sep 17 17:21:30 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:30 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.info" returned: 0 in 0.257s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.687s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Creating offline snapshot 68ea2ecc-eff4-46bd-89ae-da4328d5f664 of volume 88c2843a-1500-4467-bc70-fe06bd527c07 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:21:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7fee3b1c-5501-4e54-9b43-9d2449a5fc36 tempest-ProjectReaderTests-835462842 None] Create snapshot completed successfully Sep 17 17:21:30 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db9e05b-fcc9-4c5a-9a43-bb3b525553eb]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:30 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 Sep 17 17:21:30 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:30 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07" returned: 0 in 0.364s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:30 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 1G Sep 17 17:21:30 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:31 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 1G" returned: 0 in 0.450s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c2843a-1500-4467-bc70-fe06bd527c07 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:31 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c2843a-1500-4467-bc70-fe06bd527c07 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 Sep 17 17:21:31 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-dba60f7b-49bd-4178-829d-6fedc0bdbdad-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Lock "cinder-dba60f7b-49bd-4178-829d-6fedc0bdbdad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-b9e61620-8a49-4131-8d10-69a9ada05e36" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b9e61620-8a49-4131-8d10-69a9ada05e36" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-dba60f7b-49bd-4178-829d-6fedc0bdbdad" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-dba60f7b-49bd-4178-829d-6fedc0bdbdad" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Deleting offline snapshot dba60f7b-49bd-4178-829d-6fedc0bdbdad of volume b9e61620-8a49-4131-8d10-69a9ada05e36 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:21:31 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] snapshot_file for this snap is: volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c2843a-1500-4467-bc70-fe06bd527c07 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664" returned: 0 in 0.377s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:31 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 is being set with open permissions: ugo+rw Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a2a5bc-9ae5-41d2-9a0f-25907e27babf]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:31 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 Sep 17 17:21:31 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:31 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad Sep 17 17:21:31 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:32 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664" returned: 0 in 0.288s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:32 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.info Sep 17 17:21:32 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:32 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad" returned: 0 in 0.433s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e61620-8a49-4131-8d10-69a9ada05e36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[282b3c45-faf5-45bc-85f4-34dcd7a1f929]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:32 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.info" returned: 0 in 0.283s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:32 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.info is being set with open permissions: ugo+rw Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:32 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 Sep 17 17:21:32 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:32 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.info Sep 17 17:21:32 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:32 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.info" returned: 0 in 0.256s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:32 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.144s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36" returned: 0 in 0.417s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:32 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad Sep 17 17:21:32 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:32 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7e18ea96-411f-44ee-a6f2-d9dd18149b1d tempest-ProjectMemberTests-72633776 None] Create snapshot completed successfully Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-68ea2ecc-eff4-46bd-89ae-da4328d5f664-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Lock "cinder-68ea2ecc-eff4-46bd-89ae-da4328d5f664-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-88c2843a-1500-4467-bc70-fe06bd527c07" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-88c2843a-1500-4467-bc70-fe06bd527c07" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-68ea2ecc-eff4-46bd-89ae-da4328d5f664" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-68ea2ecc-eff4-46bd-89ae-da4328d5f664" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Deleting offline snapshot 68ea2ecc-eff4-46bd-89ae-da4328d5f664 of volume 88c2843a-1500-4467-bc70-fe06bd527c07 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] snapshot_file for this snap is: volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:21:33 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad" returned: 0 in 0.411s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d5a6b-3337-4e62-8961-3bcb0dac87ed]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:33 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad Sep 17 17:21:33 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:33 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 Sep 17 17:21:33 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:33 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36.dba60f7b-49bd-4178-829d-6fedc0bdbdad" returned: 0 in 0.268s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-dba60f7b-49bd-4178-829d-6fedc0bdbdad" released by "_delete_snapshot" :: held 1.656s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b9e61620-8a49-4131-8d10-69a9ada05e36" released by "delete_snapshot" :: held 1.689s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Created reservations ['7162ab0c-d42c-4bcd-a1b3-f113f9a5f02d', '34e46bde-824b-43ad-8765-8f0d170e857c', 'aa10a53c-08fe-4d61-93b2-2ac1117bcc04', '1ad7d89f-2519-4865-b379-89c9a126465d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:33 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664" returned: 0 in 0.404s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c2843a-1500-4467-bc70-fe06bd527c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c26697-c7f1-4307-b405-0a7ca18b43f4]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:33 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Delete snapshot completed successfully. Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5618d858-c607-4fbe-ace5-4abf33e4884c tempest-ProjectReaderTests-835462842 None] Lock "cinder-dba60f7b-49bd-4178-829d-6fedc0bdbdad-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:33 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 Sep 17 17:21:33 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-b9e61620-8a49-4131-8d10-69a9ada05e36-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Lock "cinder-b9e61620-8a49-4131-8d10-69a9ada05e36-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-b9e61620-8a49-4131-8d10-69a9ada05e36" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b9e61620-8a49-4131-8d10-69a9ada05e36" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d98cbe-84d8-4981-923c-72e1ceb12736]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:33 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07" returned: 0 in 0.449s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:33 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 Sep 17 17:21:34 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:34 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 Sep 17 17:21:34 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:34 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36" returned: 0 in 0.413s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:34 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:34 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36 Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664" returned: 0 in 0.430s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:34 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:34 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664 Sep 17 17:21:34 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:34 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b9e61620-8a49-4131-8d10-69a9ada05e36" returned: 0 in 0.248s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b9e61620-8a49-4131-8d10-69a9ada05e36" released by "delete_volume" :: held 0.736s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:34 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07.68ea2ecc-eff4-46bd-89ae-da4328d5f664" returned: 0 in 0.260s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-68ea2ecc-eff4-46bd-89ae-da4328d5f664" released by "_delete_snapshot" :: held 1.685s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-88c2843a-1500-4467-bc70-fe06bd527c07" released by "delete_snapshot" :: held 1.710s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Created reservations ['c4f0ca77-5c72-4380-ae7e-a0b2cc79d806', '58565983-6a85-4da4-b8fd-b2e4d2bc14e2', 'a8d9630c-c3da-4702-86da-b1787fbb5fd8', 'd607842f-aff1-40a8-b7b6-94c7fcf9e4b3'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Created reservations ['52cee377-f336-4083-974e-b5a80ded8e0a', '57a44002-eca2-4535-aefa-fc90a027e69d', '3d3df643-edd5-48ca-ac3f-9d89eae3384d', '20f9ddac-387f-4155-9449-5b9271f9d989'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:34 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:34 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Delete snapshot completed successfully. Sep 17 17:21:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5d5c0770-1119-48c5-9d55-17977693283a tempest-ProjectMemberTests-72633776 None] Lock "cinder-68ea2ecc-eff4-46bd-89ae-da4328d5f664-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:35 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.274s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:35 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Deleted volume successfully. Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-88c2843a-1500-4467-bc70-fe06bd527c07-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-d09a93b7-99d4-4433-9eec-41e42c459483 tempest-ProjectReaderTests-835462842 None] Lock "cinder-b9e61620-8a49-4131-8d10-69a9ada05e36-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Lock "cinder-88c2843a-1500-4467-bc70-fe06bd527c07-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-88c2843a-1500-4467-bc70-fe06bd527c07" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-88c2843a-1500-4467-bc70-fe06bd527c07" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[69170423-8251-4bbc-b78c-cc415e49eb4d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:35 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 Sep 17 17:21:35 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Flow 'volume_create_manager' (1d133dd8-ae4c-4c34-91bb-5c0c7f13249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbc8f48-2064-482d-9f62-c53c07439150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbc8f48-2064-482d-9f62-c53c07439150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-670824256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86780f8-68c2-4fca-b581-a545c65d8140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aed13e3e7014a4b9174d97df9d0252c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:36Z,use_quota=True,user_id='7323052241d74855811e5fc415d04c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429b5ea8-2fec-4d71-b9da-7df959b1a82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429b5ea8-2fec-4d71-b9da-7df959b1a82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73451f47-7ba9-40ce-94e1-e393721ee031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73451f47-7ba9-40ce-94e1-e393721ee031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86780f8-68c2-4fca-b581-a545c65d8140', 'volume_name': 'volume-b86780f8-68c2-4fca-b581-a545c65d8140', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3e717e-e27b-4abe-8559-024a544a3137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3e717e-e27b-4abe-8559-024a544a3137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ddae95-e278-4d2a-90da-6055294a5214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:35 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Volume b86780f8-68c2-4fca-b581-a545c65d8140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86780f8-68c2-4fca-b581-a545c65d8140', 'volume_size': 1} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-670824256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86780f8-68c2-4fca-b581-a545c65d8140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aed13e3e7014a4b9174d97df9d0252c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:36Z,use_quota=True,user_id='7323052241d74855811e5fc415d04c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Creating volume b86780f8-68c2-4fca-b581-a545c65d8140 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:35 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:35 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 1073741824 Sep 17 17:21:35 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:35 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07" returned: 0 in 0.464s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:35 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07 Sep 17 17:21:35 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:36 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88c2843a-1500-4467-bc70-fe06bd527c07" returned: 0 in 0.260s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-88c2843a-1500-4467-bc70-fe06bd527c07" released by "delete_volume" :: held 0.802s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Created reservations ['844542e4-b100-4e50-9617-681b3326c7a3', 'be420ba4-8068-4f46-bdd1-2eb9148924cb', 'e77f16d8-a35d-4a4a-b897-9e69d965bc17', 'f9b7595b-dfdc-4ec5-a44f-8af5a0fc9627'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:36 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 1073741824" returned: 0 in 0.542s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:36 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:36 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:36 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 Sep 17 17:21:36 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:36 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.326s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:36 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Deleted volume successfully. Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b3c5778e-08a9-4522-876f-de41750cfc2b tempest-ProjectMemberTests-72633776 None] Lock "cinder-88c2843a-1500-4467-bc70-fe06bd527c07-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:36 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140" returned: 0 in 0.325s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ddae95-e278-4d2a-90da-6055294a5214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86780f8-68c2-4fca-b581-a545c65d8140', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cc2a03-e5fb-40e1-a51c-f949363f5e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:36 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Volume volume-b86780f8-68c2-4fca-b581-a545c65d8140 (b86780f8-68c2-4fca-b581-a545c65d8140): created successfully Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cc2a03-e5fb-40e1-a51c-f949363f5e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Flow 'volume_create_manager' (1d133dd8-ae4c-4c34-91bb-5c0c7f13249e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:36 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ff805471-4be0-46ba-a159-42cc7e381e27 tempest-ProjectReaderTests-835462842 None] Created volume successfully. Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (9f7669df-a7b6-4573-9b30-15e69ed18f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9f0b13-7d63-4b7e-86b1-f240698538ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9f0b13-7d63-4b7e-86b1-f240698538ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-571803124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea008ea-6410-4371-bfb5-30b6d380abff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:37Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc273b6e-31a5-4877-839b-ee880b718bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc273b6e-31a5-4877-839b-ee880b718bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff58f63-90ad-4514-aebf-ba53f1f52378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff58f63-90ad-4514-aebf-ba53f1f52378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea008ea-6410-4371-bfb5-30b6d380abff', 'volume_name': 'volume-dea008ea-6410-4371-bfb5-30b6d380abff', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:36 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c74c118-390e-40a7-a721-cf441938b13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c74c118-390e-40a7-a721-cf441938b13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2d1b7b-a56a-4297-8d74-d08421da2fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:37 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Volume dea008ea-6410-4371-bfb5-30b6d380abff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea008ea-6410-4371-bfb5-30b6d380abff', 'volume_size': 1} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-571803124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea008ea-6410-4371-bfb5-30b6d380abff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:37Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Creating volume dea008ea-6410-4371-bfb5-30b6d380abff {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:37 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:37 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff 1073741824 Sep 17 17:21:37 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:37 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff 1073741824" returned: 0 in 0.439s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:37 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff Sep 17 17:21:37 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:37 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff" returned: 0 in 0.272s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2d1b7b-a56a-4297-8d74-d08421da2fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea008ea-6410-4371-bfb5-30b6d380abff', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e84a65-024a-47af-ae78-44c1d9c28edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:37 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Volume volume-dea008ea-6410-4371-bfb5-30b6d380abff (dea008ea-6410-4371-bfb5-30b6d380abff): created successfully Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e84a65-024a-47af-ae78-44c1d9c28edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (9f7669df-a7b6-4573-9b30-15e69ed18f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-aa55b4a7-11e6-4283-afc4-50d09515c20f tempest-ProjectMemberTests-72633776 None] Created volume successfully. Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Creating offline snapshot 83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a of volume b86780f8-68c2-4fca-b581-a545c65d8140 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa8b258-cb81-4fe6-8d41-69dd9409eb1f]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:38 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 Sep 17 17:21:38 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:38 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140" returned: 0 in 0.385s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:38 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a 1G Sep 17 17:21:38 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:38 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a 1G" returned: 0 in 0.448s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b86780f8-68c2-4fca-b581-a545c65d8140 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:38 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b86780f8-68c2-4fca-b581-a545c65d8140 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a Sep 17 17:21:38 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:39 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b86780f8-68c2-4fca-b581-a545c65d8140 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a" returned: 0 in 0.358s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:39 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a is being set with open permissions: ugo+rw Sep 17 17:21:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:39 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a Sep 17 17:21:39 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:39 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a" returned: 0 in 0.271s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:39 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.info Sep 17 17:21:39 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:39 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.info" returned: 0 in 0.260s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:39 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.info is being set with open permissions: ugo+rw Sep 17 17:21:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:39 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.info Sep 17 17:21:39 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:39 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.info" returned: 0 in 0.279s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.770s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:40 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Creating offline snapshot cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb of volume dea008ea-6410-4371-bfb5-30b6d380abff {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:21:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-65ce1184-13a9-4575-9fa4-fedecfa99c51 tempest-ProjectReaderTests-835462842 None] Create snapshot completed successfully Sep 17 17:21:40 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0bbddb-bc8a-47bb-809c-da1adea03555]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:40 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff Sep 17 17:21:40 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:40 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff" returned: 0 in 0.404s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:40 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb 1G Sep 17 17:21:40 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:41 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb 1G" returned: 0 in 0.489s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea008ea-6410-4371-bfb5-30b6d380abff -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:41 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea008ea-6410-4371-bfb5-30b6d380abff -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb Sep 17 17:21:41 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Lock "cinder-83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-b86780f8-68c2-4fca-b581-a545c65d8140" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b86780f8-68c2-4fca-b581-a545c65d8140" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Deleting offline snapshot 83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a of volume b86780f8-68c2-4fca-b581-a545c65d8140 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] snapshot_file for this snap is: volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e19b9e8-d133-43d6-9f97-ae0be281b599]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:41 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a Sep 17 17:21:41 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:41 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea008ea-6410-4371-bfb5-30b6d380abff -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb" returned: 0 in 0.425s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:41 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb is being set with open permissions: ugo+rw Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:41 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb Sep 17 17:21:41 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:41 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a" returned: 0 in 0.494s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b86780f8-68c2-4fca-b581-a545c65d8140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae733aa8-48bd-4974-9964-e29c80c1f8eb]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:41 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb" returned: 0 in 0.310s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:41 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.info Sep 17 17:21:41 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:41 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 Sep 17 17:21:41 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:42 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.info" returned: 0 in 0.330s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:42 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.info is being set with open permissions: ugo+rw Sep 17 17:21:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:42 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.info Sep 17 17:21:42 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:42 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140" returned: 0 in 0.538s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:42 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a Sep 17 17:21:42 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:42 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.info" returned: 0 in 0.341s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:42 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-7e70527c-056f-45bf-b673-792b8e5918b6 tempest-ProjectMemberTests-72633776 None] Create snapshot completed successfully Sep 17 17:21:42 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a" returned: 0 in 0.422s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:42 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a Sep 17 17:21:42 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:42 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140.83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a" returned: 0 in 0.273s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a" released by "_delete_snapshot" :: held 1.846s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b86780f8-68c2-4fca-b581-a545c65d8140" released by "delete_snapshot" :: held 1.871s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Created reservations ['8c05cdc6-be40-4991-85eb-7262352c9466', '891605be-24f9-4b60-b372-c137b2f63c65', '7c831d8c-67c6-464b-b891-20400dec12fd', '9e2eed07-f0b3-413e-819a-68dedebe7408'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:43 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Delete snapshot completed successfully. Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a192ff3e-4241-4cb0-94fc-7e62f94841c8 tempest-ProjectReaderTests-835462842 None] Lock "cinder-83d793e5-e81e-4e9e-ac40-7b8a2cb7d55a-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-b86780f8-68c2-4fca-b581-a545c65d8140-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Lock "cinder-b86780f8-68c2-4fca-b581-a545c65d8140-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-b86780f8-68c2-4fca-b581-a545c65d8140" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b86780f8-68c2-4fca-b581-a545c65d8140" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1fe9f0-96d3-480c-af4e-e3764959d531]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Lock "cinder-cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-dea008ea-6410-4371-bfb5-30b6d380abff" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-dea008ea-6410-4371-bfb5-30b6d380abff" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Deleting offline snapshot cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb of volume dea008ea-6410-4371-bfb5-30b6d380abff {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] snapshot_file for this snap is: volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff716cc8-b7d6-4f67-8826-abd82750ed04]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:43 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 Sep 17 17:21:43 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:43 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb Sep 17 17:21:43 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:43 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140" returned: 0 in 0.434s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:43 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140 Sep 17 17:21:43 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:44 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb" returned: 0 in 0.425s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dea008ea-6410-4371-bfb5-30b6d380abff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f99af3-61fb-474b-b139-45b17daa75f5]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:44 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b86780f8-68c2-4fca-b581-a545c65d8140" returned: 0 in 0.296s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:44 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff Sep 17 17:21:44 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b86780f8-68c2-4fca-b581-a545c65d8140" released by "delete_volume" :: held 0.850s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Created reservations ['fecc01d1-9cc0-4299-8a22-cd6f96fa0547', 'dcf61516-d413-4865-a8bb-15a04ecffeda', 'c971daa6-a187-4b76-9d46-255adceffb41', 'a2f4c416-d958-466c-9505-4db2d3245f37'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:44 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:44 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:44 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff" returned: 0 in 0.549s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:44 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb Sep 17 17:21:44 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:44 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.380s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:44 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Deleted volume successfully. Sep 17 17:21:44 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-46034621-6ae4-4cb4-905f-f5da1918c944 tempest-ProjectReaderTests-835462842 None] Lock "cinder-b86780f8-68c2-4fca-b581-a545c65d8140-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:45 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb" returned: 0 in 0.507s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:45 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb Sep 17 17:21:45 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Flow 'volume_create_manager' (b3d2ca7c-aabb-4193-a0eb-164346461318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5e1560-14a8-4f7c-b8f2-9fa814a3d6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5e1560-14a8-4f7c-b8f2-9fa814a3d6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436556136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329df262-fc00-4cdb-ab35-8c53c3a10a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aed13e3e7014a4b9174d97df9d0252c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:45Z,use_quota=True,user_id='7323052241d74855811e5fc415d04c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb92f5c1-c2b3-4183-8900-b8c770ae71a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb92f5c1-c2b3-4183-8900-b8c770ae71a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3260de95-d46b-4504-858e-2a699f6e789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3260de95-d46b-4504-858e-2a699f6e789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329df262-fc00-4cdb-ab35-8c53c3a10a8b', 'volume_name': 'volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96de357-10aa-47d0-b256-9647edc330be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96de357-10aa-47d0-b256-9647edc330be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a392a9-c2f3-4384-8715-df1756333c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:45 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Volume 329df262-fc00-4cdb-ab35-8c53c3a10a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b', 'volume_size': 1} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-436556136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329df262-fc00-4cdb-ab35-8c53c3a10a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aed13e3e7014a4b9174d97df9d0252c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:45Z,use_quota=True,user_id='7323052241d74855811e5fc415d04c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Creating volume 329df262-fc00-4cdb-ab35-8c53c3a10a8b {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:45 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:45 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b 1073741824 Sep 17 17:21:45 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:45 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff.cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb" returned: 0 in 0.284s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb" released by "_delete_snapshot" :: held 1.903s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-dea008ea-6410-4371-bfb5-30b6d380abff" released by "delete_snapshot" :: held 1.928s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Created reservations ['3290904a-2d3a-4309-9d2a-e702b2050d9c', '22b9fe62-8d0a-4ac6-bfac-bea0c1ec3511', '92978363-95d1-4a46-b64d-cf3273c04c70', '3b101939-406a-480c-b6b9-15ba15b4fd0d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Delete snapshot completed successfully. Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-afec2d81-6348-4b2d-b20f-fdd3f553e000 tempest-ProjectMemberTests-72633776 None] Lock "cinder-cef57756-9f33-4bd5-8e4d-9d3eb0ae7bbb-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-dea008ea-6410-4371-bfb5-30b6d380abff-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Lock "cinder-dea008ea-6410-4371-bfb5-30b6d380abff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-dea008ea-6410-4371-bfb5-30b6d380abff" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-dea008ea-6410-4371-bfb5-30b6d380abff" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96a5431-b008-4626-bd6a-01f422a27029]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:45 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b 1073741824" returned: 0 in 0.602s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:45 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b Sep 17 17:21:45 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:46 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff Sep 17 17:21:46 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:46 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b" returned: 0 in 0.337s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a392a9-c2f3-4384-8715-df1756333c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e2cd8-5c7b-4d91-acf4-e50cc1ba8759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:46 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Volume volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b (329df262-fc00-4cdb-ab35-8c53c3a10a8b): created successfully Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e2cd8-5c7b-4d91-acf4-e50cc1ba8759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:46 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Flow 'volume_create_manager' (b3d2ca7c-aabb-4193-a0eb-164346461318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff" returned: 0 in 0.438s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bdd4ab26-b189-4f7c-9434-6360ab17a10d tempest-ProjectReaderTests-835462842 None] Created volume successfully. Sep 17 17:21:46 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff Sep 17 17:21:46 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:46 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-dea008ea-6410-4371-bfb5-30b6d380abff" returned: 0 in 0.259s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-dea008ea-6410-4371-bfb5-30b6d380abff" released by "delete_volume" :: held 0.775s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Created reservations ['0be956ee-414a-4850-8e0d-8a4b5ce685b2', '7bc78e12-9ee4-4e84-8bab-2d4f679da663', 'a5b66910-d539-4a59-be0b-0641f8aecb84', '76912267-1ca5-4770-9e4d-0d2c7f236c31'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:46 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:46 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:47 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.274s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:47 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Deleted volume successfully. Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-f8066e5c-a57e-4c6d-9bb2-a000d65d9525 tempest-ProjectMemberTests-72633776 None] Lock "cinder-dea008ea-6410-4371-bfb5-30b6d380abff-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (495462cc-9895-4643-8f1b-282b9143ab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1966e32-31f5-4952-8c89-c92f027680ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1966e32-31f5-4952-8c89-c92f027680ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826151262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93dfbb1-3216-48cd-9cb9-d9100d5d22ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:47Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2908c5c-93b2-4889-8ba2-e71c93e3ad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2908c5c-93b2-4889-8ba2-e71c93e3ad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ba0e5a-702e-44bf-8991-86be07a29e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ba0e5a-702e-44bf-8991-86be07a29e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93dfbb1-3216-48cd-9cb9-d9100d5d22ab', 'volume_name': 'volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b51289e-88c7-455b-997f-314b711743f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b51289e-88c7-455b-997f-314b711743f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232b6ef4-03c7-4109-a2d4-03c3e9a13a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:47 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Volume d93dfbb1-3216-48cd-9cb9-d9100d5d22ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab', 'volume_size': 1} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Creating offline snapshot ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 of volume 329df262-fc00-4cdb-ab35-8c53c3a10a8b {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e95e79c-e874-4af3-9a3f-687fa9646a85]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:47 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b Sep 17 17:21:47 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:48 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b" returned: 0 in 0.388s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:48 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 1G Sep 17 17:21:48 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:48 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 1G" returned: 0 in 0.421s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:48 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 Sep 17 17:21:48 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:48 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7" returned: 0 in 0.302s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:48 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 is being set with open permissions: ugo+rw Sep 17 17:21:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:48 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 Sep 17 17:21:48 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:49 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7" returned: 0 in 0.258s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:49 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.info Sep 17 17:21:49 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:49 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.info" returned: 0 in 0.275s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:49 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.info is being set with open permissions: ugo+rw Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:49 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.info Sep 17 17:21:49 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:49 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.info" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.002s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826151262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93dfbb1-3216-48cd-9cb9-d9100d5d22ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:47Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Creating volume d93dfbb1-3216-48cd-9cb9-d9100d5d22ab {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:49 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:49 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab 1073741824 Sep 17 17:21:49 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:49 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-8e29f8db-7776-4317-9523-821666773a20 tempest-ProjectReaderTests-835462842 None] Create snapshot completed successfully Sep 17 17:21:50 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab 1073741824" returned: 0 in 0.554s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:50 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab Sep 17 17:21:50 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:50 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" returned: 0 in 0.263s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232b6ef4-03c7-4109-a2d4-03c3e9a13a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de90f46a-f9b2-4dc9-b5ca-390c9bf70059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:50 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Volume volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab (d93dfbb1-3216-48cd-9cb9-d9100d5d22ab): created successfully Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de90f46a-f9b2-4dc9-b5ca-390c9bf70059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (495462cc-9895-4643-8f1b-282b9143ab78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:50 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d2de1ebc-d0e7-4ebd-ae73-949bdbc8c438 tempest-ProjectMemberTests-72633776 None] Created volume successfully. Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Lock "cinder-ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-329df262-fc00-4cdb-ab35-8c53c3a10a8b" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-329df262-fc00-4cdb-ab35-8c53c3a10a8b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Deleting offline snapshot ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 of volume 329df262-fc00-4cdb-ab35-8c53c3a10a8b {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] snapshot_file for this snap is: volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2021df-19c4-45ec-9173-1162b284dda3]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:50 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 Sep 17 17:21:50 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:51 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7" returned: 0 in 0.396s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[64199004-f4c0-4481-84e3-e7b440a8495a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:51 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b Sep 17 17:21:51 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:51 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b" returned: 0 in 0.391s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:51 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 Sep 17 17:21:51 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Creating offline snapshot e081df24-18b0-4727-9df9-4a5525d5d913 of volume d93dfbb1-3216-48cd-9cb9-d9100d5d22ab {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c086180-a827-4d1e-a5bd-ce69fc94a6ff]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:52 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7" returned: 0 in 0.411s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:52 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7 Sep 17 17:21:52 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:52 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab Sep 17 17:21:52 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:52 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b.ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7" returned: 0 in 0.280s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7" released by "_delete_snapshot" :: held 1.611s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-329df262-fc00-4cdb-ab35-8c53c3a10a8b" released by "delete_snapshot" :: held 1.639s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:52 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" returned: 0 in 0.429s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:52 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 1G Sep 17 17:21:52 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Created reservations ['d4f16531-18e7-46ec-b9f6-0b2a4eb879e1', '139fb415-90e4-438b-88f8-701f2641340d', 'd1efd867-54f8-427a-a5e2-02ff246124ce', 'e2386eff-650a-4a9c-a2cc-3a33ee4044b7'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:52 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Delete snapshot completed successfully. Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-45ddc2cd-f7a3-4319-baaa-2c3c2f941d3e tempest-ProjectReaderTests-835462842 None] Lock "cinder-ef71ab46-ba6e-4f30-bd53-1b1ad34c9cd7-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-329df262-fc00-4cdb-ab35-8c53c3a10a8b-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Lock "cinder-329df262-fc00-4cdb-ab35-8c53c3a10a8b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-329df262-fc00-4cdb-ab35-8c53c3a10a8b" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-329df262-fc00-4cdb-ab35-8c53c3a10a8b" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:52 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 1G" returned: 0 in 0.606s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[741bf938-9444-4b37-9125-cf915ba5a7b9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:53 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 Sep 17 17:21:53 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:53 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b Sep 17 17:21:53 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:53 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913" returned: 0 in 0.332s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:53 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 is being set with open permissions: ugo+rw Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:53 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 Sep 17 17:21:53 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:53 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b" returned: 0 in 0.426s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:53 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b Sep 17 17:21:53 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:53 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913" returned: 0 in 0.272s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:53 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.info Sep 17 17:21:53 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:53 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-329df262-fc00-4cdb-ab35-8c53c3a10a8b" returned: 0 in 0.273s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-329df262-fc00-4cdb-ab35-8c53c3a10a8b" released by "delete_volume" :: held 0.776s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Created reservations ['5f9e0837-7358-4cec-a01c-c320789edcb1', '8255c53a-15f6-47c5-b0d7-24dd83ebcd36', 'dff107f1-369e-466b-96d4-1b0a00802041', '3fb46af2-116c-4911-862d-1c39cb68a428'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:53 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:53 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:53 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.info" returned: 0 in 0.276s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:53 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.info is being set with open permissions: ugo+rw Sep 17 17:21:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:53 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.info Sep 17 17:21:53 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:54 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.284s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Deleted volume successfully. Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b0599420-c40b-40f0-abc7-e50f3c6ed43b tempest-ProjectReaderTests-835462842 None] Lock "cinder-329df262-fc00-4cdb-ab35-8c53c3a10a8b-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:54 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.info" returned: 0 in 0.327s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.344s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a3ea8cd8-1edd-43b5-b5e3-76965af99be1 tempest-ProjectMemberTests-72633776 None] Create snapshot completed successfully Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Flow 'volume_create_manager' (6aa0733d-f64d-4ab3-9c83-c44371d9f27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed32029d-db29-477e-a398-56423355fdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed32029d-db29-477e-a398-56423355fdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-460797187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b452d541-68b8-4fbd-b9e2-ddae5e2b73ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aed13e3e7014a4b9174d97df9d0252c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:54Z,use_quota=True,user_id='7323052241d74855811e5fc415d04c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9070b292-78f3-4b69-a3e9-457e64c0b7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9070b292-78f3-4b69-a3e9-457e64c0b7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd92b30-ad60-4282-96df-5271d6686982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd92b30-ad60-4282-96df-5271d6686982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b452d541-68b8-4fbd-b9e2-ddae5e2b73ad', 'volume_name': 'volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7f53e-8ad1-401d-aaef-31b3d6d2658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7f53e-8ad1-401d-aaef-31b3d6d2658a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbbd650-c27a-4d5b-b3a4-b46c895bbc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:54 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Volume b452d541-68b8-4fbd-b9e2-ddae5e2b73ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad', 'volume_size': 1} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-460797187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b452d541-68b8-4fbd-b9e2-ddae5e2b73ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aed13e3e7014a4b9174d97df9d0252c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:54Z,use_quota=True,user_id='7323052241d74855811e5fc415d04c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Creating volume b452d541-68b8-4fbd-b9e2-ddae5e2b73ad {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:54 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:54 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad 1073741824 Sep 17 17:21:54 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-e081df24-18b0-4727-9df9-4a5525d5d913-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Lock "cinder-e081df24-18b0-4727-9df9-4a5525d5d913-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-e081df24-18b0-4727-9df9-4a5525d5d913" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:55 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-e081df24-18b0-4727-9df9-4a5525d5d913" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Deleting offline snapshot e081df24-18b0-4727-9df9-4a5525d5d913 of volume d93dfbb1-3216-48cd-9cb9-d9100d5d22ab {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] snapshot_file for this snap is: volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad 1073741824" returned: 0 in 0.587s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fad448b-fae7-4100-a0bf-e235fac7f729]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:55 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad Sep 17 17:21:55 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:55 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 Sep 17 17:21:55 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:55 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" returned: 0 in 0.363s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbbd650-c27a-4d5b-b3a4-b46c895bbc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38caed4-7139-4095-8eea-84d93939e164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:55 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Volume volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad (b452d541-68b8-4fbd-b9e2-ddae5e2b73ad): created successfully Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38caed4-7139-4095-8eea-84d93939e164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Flow 'volume_create_manager' (6aa0733d-f64d-4ab3-9c83-c44371d9f27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:55 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913" returned: 0 in 0.483s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:21:55 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-191f386f-ad94-4dd8-a2e7-3a40605d63b2 tempest-ProjectReaderTests-835462842 None] Created volume successfully. Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[717e2776-db08-423a-8457-2c54b319fd12]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:55 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab Sep 17 17:21:55 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:56 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" returned: 0 in 0.423s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:56 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 Sep 17 17:21:56 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:56 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913" returned: 0 in 0.387s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:56 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913 Sep 17 17:21:56 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Creating offline snapshot 97559787-66d4-4b97-95eb-31b60176788c of volume b452d541-68b8-4fbd-b9e2-ddae5e2b73ad {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:21:56 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab.e081df24-18b0-4727-9df9-4a5525d5d913" returned: 0 in 0.275s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf0e90f-d3d6-401f-963a-a271d4774f55]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-e081df24-18b0-4727-9df9-4a5525d5d913" released by "_delete_snapshot" :: held 1.726s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" released by "delete_snapshot" :: held 1.754s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:56 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Created reservations ['0a8a0ad5-635f-460d-a5f9-94ee075d4cad', '113a291c-d7b9-461a-8e61-c362faa5a5b7', '3c77602c-daee-4ed6-b941-6fd4bd4069ea', 'a0671225-3cd2-4154-94c1-853a6f7b6938'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:57 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad Sep 17 17:21:57 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:57 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Delete snapshot completed successfully. Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6a1be601-d534-4602-be1f-ac25179284d1 tempest-ProjectMemberTests-72633776 None] Lock "cinder-e081df24-18b0-4727-9df9-4a5525d5d913-delete_snapshot" released by "delete_snapshot" :: held 1.915s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Flow 'volume_create_manager' (a59aebd7-b97a-4405-9fea-2cf3d5f29664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60181a5-5f31-48ff-b874-f6ac7543b424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60181a5-5f31-48ff-b874-f6ac7543b424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-134932270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97e8fc0-dad5-498d-895d-82d022191cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd277881484433c81fc5a5a53576c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:57Z,use_quota=True,user_id='e43b7d50fea348268d19414af31e9ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4130593-9712-4a15-bc9d-09a17e4c4d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4130593-9712-4a15-bc9d-09a17e4c4d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a68f011-a9a2-49be-a6e7-add7dc7c9957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a68f011-a9a2-49be-a6e7-add7dc7c9957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a97e8fc0-dad5-498d-895d-82d022191cc6', 'volume_name': 'volume-a97e8fc0-dad5-498d-895d-82d022191cc6', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afa4160-501f-4e2e-8cbd-b684f72d2b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afa4160-501f-4e2e-8cbd-b684f72d2b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c035c78f-fd49-4e5c-8fa3-f397a0f94dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:57 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Volume a97e8fc0-dad5-498d-895d-82d022191cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a97e8fc0-dad5-498d-895d-82d022191cc6', 'volume_size': 1} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:57 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" returned: 0 in 0.415s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Lock "cinder-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:57 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c 1G Sep 17 17:21:57 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b03110-3f1a-4309-99b6-d9b866a52930]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:57 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab Sep 17 17:21:57 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:57 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c 1G" returned: 0 in 0.420s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:57 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c Sep 17 17:21:57 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:57 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" returned: 0 in 0.384s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:57 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:57 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab Sep 17 17:21:57 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:58 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c" returned: 0 in 0.307s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:58 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c is being set with open permissions: ugo+rw Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:58 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c Sep 17 17:21:58 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:58 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" returned: 0 in 0.271s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab" released by "delete_volume" :: held 0.735s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Created reservations ['fa97c679-13e5-4fb1-8f29-be7e51c6e87b', 'e4549ca2-b28a-4cb4-9d56-aac96413e1da', '40b240c5-eb40-4fac-9655-ab081920b767', '629e129e-fca4-470b-a5c2-5c10d22f382e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:58 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:21:58 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:58 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c" returned: 0 in 0.266s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:58 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.info Sep 17 17:21:58 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:58 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.256s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:21:58 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Deleted volume successfully. Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-54c18de9-473c-4f55-b80d-d03ffce0ec7d tempest-ProjectMemberTests-72633776 None] Lock "cinder-d93dfbb1-3216-48cd-9cb9-d9100d5d22ab-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:21:58 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.info" returned: 0 in 0.287s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:58 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.info is being set with open permissions: ugo+rw Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:58 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.info Sep 17 17:21:58 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:58 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.info" returned: 0 in 0.248s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-134932270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97e8fc0-dad5-498d-895d-82d022191cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd277881484433c81fc5a5a53576c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:57Z,use_quota=True,user_id='e43b7d50fea348268d19414af31e9ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Creating volume a97e8fc0-dad5-498d-895d-82d022191cc6 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:58 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:58 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 1073741824 Sep 17 17:21:58 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:58 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f6acd6d4-7cb5-4066-a5a1-a47f887cbf08 tempest-ProjectReaderTests-835462842 None] Create snapshot completed successfully Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (46f862f3-b928-4390-bb39-9da81b0c9b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:58 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccad939-375a-458a-a481-2c8cfc67e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccad939-375a-458a-a481-2c8cfc67e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1866625438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ca6bfc-6502-4128-b1b2-7b6090710c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:59Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3b0b5e-f03f-48d5-ba48-74f1c77765af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3b0b5e-f03f-48d5-ba48-74f1c77765af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e62089-0045-44fa-8fcb-fdad61659299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e62089-0045-44fa-8fcb-fdad61659299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3ca6bfc-6502-4128-b1b2-7b6090710c76', 'volume_name': 'volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45faa26a-0913-4b84-9dc4-2194959fdb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45faa26a-0913-4b84-9dc4-2194959fdb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6df6fa1-3a81-4991-9eb7-f561b30c5ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:59 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Volume f3ca6bfc-6502-4128-b1b2-7b6090710c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76', 'volume_size': 1} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:59 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 1073741824" returned: 0 in 0.409s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:59 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 Sep 17 17:21:59 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:59 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6" returned: 0 in 0.247s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1866625438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ca6bfc-6502-4128-b1b2-7b6090710c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:21:59Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Creating volume f3ca6bfc-6502-4128-b1b2-7b6090710c76 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:21:59 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c035c78f-fd49-4e5c-8fa3-f397a0f94dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97e8fc0-dad5-498d-895d-82d022191cc6', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:59 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 1073741824 Sep 17 17:21:59 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb07ea75-395c-474a-9e94-cb9309099829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:21:59 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Volume volume-a97e8fc0-dad5-498d-895d-82d022191cc6 (a97e8fc0-dad5-498d-895d-82d022191cc6): created successfully Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb07ea75-395c-474a-9e94-cb9309099829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Flow 'volume_create_manager' (a59aebd7-b97a-4405-9fea-2cf3d5f29664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:21:59 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-f4c83f14-ee30-4998-800a-c5a39171e4c9 tempest-SnapshotDependencyTests-318949823 None] Created volume successfully. Sep 17 17:21:59 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-97559787-66d4-4b97-95eb-31b60176788c-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Lock "cinder-97559787-66d4-4b97-95eb-31b60176788c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-97559787-66d4-4b97-95eb-31b60176788c" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-97559787-66d4-4b97-95eb-31b60176788c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Deleting offline snapshot 97559787-66d4-4b97-95eb-31b60176788c of volume b452d541-68b8-4fbd-b9e2-ddae5e2b73ad {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:22:00 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] snapshot_file for this snap is: volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 1073741824" returned: 0 in 0.471s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46b9b22-15cb-4f7d-82a0-0975c4f075d9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:00 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 Sep 17 17:22:00 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:00 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c Sep 17 17:22:00 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:00 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76" returned: 0 in 0.284s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6df6fa1-3a81-4991-9eb7-f561b30c5ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9cf784-326e-490e-a908-50e24f5c8ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:00 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Volume volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 (f3ca6bfc-6502-4128-b1b2-7b6090710c76): created successfully Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9cf784-326e-490e-a908-50e24f5c8ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (46f862f3-b928-4390-bb39-9da81b0c9b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:00 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-77a530c0-e37a-4acf-a084-519c222e015b tempest-ProjectMemberTests-72633776 None] Created volume successfully. Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Creating offline snapshot c6674dd8-4a2f-48c6-bed3-c2d00d92920f of volume a97e8fc0-dad5-498d-895d-82d022191cc6 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:22:00 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8c6263-b487-43d8-9b2e-8dfaf7cdb3b7]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c" returned: 0 in 0.439s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea74947c-7d4d-4cf8-b772-5e279b4b2b01]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:00 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 Sep 17 17:22:00 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:00 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad Sep 17 17:22:00 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:00 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6" returned: 0 in 0.362s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:00 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f 1G Sep 17 17:22:00 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:00 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" returned: 0 in 0.377s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:00 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:00 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c Sep 17 17:22:00 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:01 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c" returned: 0 in 0.383s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:01 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f 1G" returned: 0 in 0.454s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a97e8fc0-dad5-498d-895d-82d022191cc6 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:01 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c Sep 17 17:22:01 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:01 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a97e8fc0-dad5-498d-895d-82d022191cc6 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f Sep 17 17:22:01 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:01 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad.97559787-66d4-4b97-95eb-31b60176788c" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-97559787-66d4-4b97-95eb-31b60176788c" released by "_delete_snapshot" :: held 1.579s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" released by "delete_snapshot" :: held 1.603s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:01 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a97e8fc0-dad5-498d-895d-82d022191cc6 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f" returned: 0 in 0.301s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:01 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f is being set with open permissions: ugo+rw Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:01 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f Sep 17 17:22:01 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Created reservations ['e25ec61d-2934-470e-9ab7-da645e5a5976', '9da88e5b-8be0-4c41-bf5e-8b470701c90e', '9d9e3a0f-96e2-48fc-8e02-d339cc976286', 'ae34858e-b3d0-49de-9d0e-e0564093e4a7'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:01 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Delete snapshot completed successfully. Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f187249-9ef1-42c9-a2e3-ca929815d169 tempest-ProjectReaderTests-835462842 None] Lock "cinder-97559787-66d4-4b97-95eb-31b60176788c-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:01 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f" returned: 0 in 0.248s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:01 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:01 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.info Sep 17 17:22:01 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:02 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.info" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:02 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.info is being set with open permissions: ugo+rw Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Lock "cinder-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:02 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.info Sep 17 17:22:02 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34446c2-1851-4c8c-bdf8-c7ed7f73477c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:02 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad Sep 17 17:22:02 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:02 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.info" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.288s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Creating offline snapshot e20e1183-533e-4cc9-91f9-3a86847bad71 of volume f3ca6bfc-6502-4128-b1b2-7b6090710c76 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:22:02 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a4b28013-026c-4926-b343-64529a4e6384 tempest-SnapshotDependencyTests-318949823 None] Create snapshot completed successfully Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c61005-cdc3-4ee9-8419-c19f74cbfefb]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:02 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 Sep 17 17:22:02 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:02 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" returned: 0 in 0.380s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:02 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad Sep 17 17:22:02 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:02 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76" returned: 0 in 0.375s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:02 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 1G Sep 17 17:22:02 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:02 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:02 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad" released by "delete_volume" :: held 0.703s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Created reservations ['d00ea860-8e53-418d-a95a-973114ed25d8', 'da4d64fd-827a-499e-8944-1d666edc778c', '1deb1f83-7e58-40df-b73d-d8d28327e111', '16ca871e-54cc-42ea-a1f1-4dc7bd22a51e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:03 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:03 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:03 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 1G" returned: 0 in 0.457s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:03 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.280s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:03 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Deleted volume successfully. Sep 17 17:22:03 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 Sep 17 17:22:03 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-16b96968-bcf5-4b63-aa8d-d3913720d58a tempest-ProjectReaderTests-835462842 None] Lock "cinder-b452d541-68b8-4fbd-b9e2-ddae5e2b73ad-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:03 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71" returned: 0 in 0.359s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:03 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 is being set with open permissions: ugo+rw Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:03 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 Sep 17 17:22:03 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Flow 'volume_create_manager' (b92e0acb-3cc1-4cc6-8323-caf13a1dbfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa09c65-bbe4-4fc2-9891-2bef24c4d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa09c65-bbe4-4fc2-9891-2bef24c4d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433377251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8846ab-8848-4686-a596-2d496bf8c984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aed13e3e7014a4b9174d97df9d0252c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:04Z,use_quota=True,user_id='7323052241d74855811e5fc415d04c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829ca2f6-6ded-42f6-ab20-860668e06098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829ca2f6-6ded-42f6-ab20-860668e06098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1908407e-2c3f-4770-bfb1-53d9458a5de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1908407e-2c3f-4770-bfb1-53d9458a5de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd8846ab-8848-4686-a596-2d496bf8c984', 'volume_name': 'volume-fd8846ab-8848-4686-a596-2d496bf8c984', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c48e45-caed-415a-a327-88aacd30db70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c48e45-caed-415a-a327-88aacd30db70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a46daa3-fe42-480d-a9dc-0aba75b46396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:03 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Volume fd8846ab-8848-4686-a596-2d496bf8c984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd8846ab-8848-4686-a596-2d496bf8c984', 'volume_size': 1} Sep 17 17:22:03 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:03 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71" returned: 0 in 0.279s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:04 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.info Sep 17 17:22:04 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Flow 'volume_create_manager' (e02eefad-d314-4100-b8ab-d666aa497223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b12d17-65cb-4ce7-ab18-6254d12fbe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:04 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b12d17-65cb-4ce7-ab18-6254d12fbe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ae2564-ffb9-425e-906b-234711cfa414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd277881484433c81fc5a5a53576c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c6674dd8-4a2f-48c6-bed3-c2d00d92920f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:04Z,use_quota=True,user_id='e43b7d50fea348268d19414af31e9ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058294f4-efde-4f53-a89f-a4f7f4fc08f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058294f4-efde-4f53-a89f-a4f7f4fc08f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50023ea-5893-4de5-a38e-4a9ce7460328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50023ea-5893-4de5-a38e-4a9ce7460328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '09ae2564-ffb9-425e-906b-234711cfa414', 'volume_name': 'volume-09ae2564-ffb9-425e-906b-234711cfa414', 'volume_size': 1, 'snapshot_id': 'c6674dd8-4a2f-48c6-bed3-c2d00d92920f'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5deb9a24-8a77-4dc1-bf43-52d3c48923b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5deb9a24-8a77-4dc1-bf43-52d3c48923b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (585cf7f1-4e4e-4c3a-881d-44647f87e36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:04 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Volume 09ae2564-ffb9-425e-906b-234711cfa414: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-09ae2564-ffb9-425e-906b-234711cfa414', 'volume_size': 1, 'snapshot_id': 'c6674dd8-4a2f-48c6-bed3-c2d00d92920f'} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.info" returned: 0 in 0.335s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:04 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.info is being set with open permissions: ugo+rw Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:04 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.info Sep 17 17:22:04 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:04 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.info" returned: 0 in 0.249s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.699s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433377251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8846ab-8848-4686-a596-2d496bf8c984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aed13e3e7014a4b9174d97df9d0252c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:04Z,use_quota=True,user_id='7323052241d74855811e5fc415d04c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Creating volume fd8846ab-8848-4686-a596-2d496bf8c984 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:04 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:22:04 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:04 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 1073741824 Sep 17 17:22:04 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:04 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-88085c07-863c-42c6-9865-95f05c765fe5 tempest-ProjectMemberTests-72633776 None] Create snapshot completed successfully Sep 17 17:22:05 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 1073741824" returned: 0 in 0.418s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:05 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 Sep 17 17:22:05 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:05 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984" returned: 0 in 0.263s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.983s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "cinder-quobyte-c6674dd8-4a2f-48c6-bed3-c2d00d92920f-09ae2564-ffb9-425e-906b-234711cfa414" by "_create_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a46daa3-fe42-480d-a9dc-0aba75b46396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8846ab-8848-4686-a596-2d496bf8c984', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc073d7-b0fd-44a4-aecf-796080c05589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-c6674dd8-4a2f-48c6-bed3-c2d00d92920f-09ae2564-ffb9-425e-906b-234711cfa414" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Creating volume 09ae2564-ffb9-425e-906b-234711cfa414 from snapshot c6674dd8-4a2f-48c6-bed3-c2d00d92920f {{(pid=85889) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "cinder-quobyte-09ae2564-ffb9-425e-906b-234711cfa414" by "_copy_volume_from_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:05 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Volume volume-fd8846ab-8848-4686-a596-2d496bf8c984 (fd8846ab-8848-4686-a596-2d496bf8c984): created successfully Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc073d7-b0fd-44a4-aecf-796080c05589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Flow 'volume_create_manager' (b92e0acb-3cc1-4cc6-8323-caf13a1dbfc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-e20e1183-533e-4cc9-91f9-3a86847bad71-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-09ae2564-ffb9-425e-906b-234711cfa414" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] snapshot: c6674dd8-4a2f-48c6-bed3-c2d00d92920f, volume: 09ae2564-ffb9-425e-906b-234711cfa414, {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Lock "cinder-e20e1183-533e-4cc9-91f9-3a86847bad71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-f3ca6bfc-6502-4128-b1b2-7b6090710c76" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:05 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-06bc33ac-f3de-45a8-977e-61ae90633436 tempest-ProjectReaderTests-835462842 None] Created volume successfully. Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-f3ca6bfc-6502-4128-b1b2-7b6090710c76" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-e20e1183-533e-4cc9-91f9-3a86847bad71" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0930e837-2b4b-434b-aa0e-fbd70b2543f6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-e20e1183-533e-4cc9-91f9-3a86847bad71" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Deleting offline snapshot e20e1183-533e-4cc9-91f9-3a86847bad71 of volume f3ca6bfc-6502-4128-b1b2-7b6090710c76 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] snapshot_file for this snap is: volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc80db3d-8796-4a1b-9248-940151c7bdb0]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:05 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f Sep 17 17:22:05 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:05 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 Sep 17 17:22:05 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:05 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f" returned: 0 in 0.398s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a97e8fc0-dad5-498d-895d-82d022191cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d17851-e08a-435a-949a-492f1d00d32d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:05 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71" returned: 0 in 0.384s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db754ef-58da-4374-b56c-76122ae30a10]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:06 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 Sep 17 17:22:06 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:06 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 Sep 17 17:22:06 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:06 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6" returned: 0 in 0.435s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Creating direct copy from snapshot {{(pid=85889) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG cinder.utils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Path /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 not found in is_blk_device check {{(pid=85889) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:06 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 Sep 17 17:22:06 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:06 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76" returned: 0 in 0.416s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:06 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 Sep 17 17:22:06 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:06 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71" returned: 0 in 0.331s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:06 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71 Sep 17 17:22:06 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:07 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76.e20e1183-533e-4cc9-91f9-3a86847bad71" returned: 0 in 0.425s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-e20e1183-533e-4cc9-91f9-3a86847bad71" released by "_delete_snapshot" :: held 1.729s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-f3ca6bfc-6502-4128-b1b2-7b6090710c76" released by "delete_snapshot" :: held 1.770s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Created reservations ['c580eebe-88fe-40c9-95a6-742e9913066b', '7ff7ffbe-fbbe-4220-bf90-99e0e173bc73', 'dc268f2a-cb1c-44b6-8f06-d3bc0567f3b8', 'b7e830cc-1035-4b7a-95d9-ae6d6c58b286'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:07 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Delete snapshot completed successfully. Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-359a5d1e-dd96-4157-ba25-5c73d72bbd82 tempest-ProjectMemberTests-72633776 None] Lock "cinder-e20e1183-533e-4cc9-91f9-3a86847bad71-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-f3ca6bfc-6502-4128-b1b2-7b6090710c76-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Lock "cinder-f3ca6bfc-6502-4128-b1b2-7b6090710c76-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-f3ca6bfc-6502-4128-b1b2-7b6090710c76" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-f3ca6bfc-6502-4128-b1b2-7b6090710c76" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[43250a81-58c3-4775-8c4c-5d47cb87268e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:08 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 Sep 17 17:22:08 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:08 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76" returned: 0 in 0.635s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:08 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76 Sep 17 17:22:08 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:08 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-f3ca6bfc-6502-4128-b1b2-7b6090710c76" returned: 0 in 0.362s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-f3ca6bfc-6502-4128-b1b2-7b6090710c76" released by "delete_volume" :: held 1.134s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:09 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Created reservations ['73b269bf-4da2-41c9-a63e-168c7582ac36', '761a1c05-6f03-4147-9fd1-2807f7b891fc', 'ae7145df-8d6b-45ce-98d9-7ad03fb0b6fe', '4ae25335-391a-4703-aee9-6d38f8331c81'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:09 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:09 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:09 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.368s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:09 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Deleted volume successfully. Sep 17 17:22:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ce716a55-0336-4a79-aff9-90cb5619743d tempest-ProjectMemberTests-72633776 None] Lock "cinder-f3ca6bfc-6502-4128-b1b2-7b6090710c76-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (9a71d9c8-695a-48c6-8e21-dd4787502398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edc9194-460a-4007-9e45-70a6c37538dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edc9194-460a-4007-9e45-70a6c37538dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606072867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3be0b52-78f2-4ad9-90f9-a1b991f811a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:11Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c59fbd1-8fa0-4058-84fc-b63ab50e9a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c59fbd1-8fa0-4058-84fc-b63ab50e9a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb698f82-22f3-4d7b-b482-26fa948f17fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb698f82-22f3-4d7b-b482-26fa948f17fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3be0b52-78f2-4ad9-90f9-a1b991f811a9', 'volume_name': 'volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67518e56-0277-44b8-aa98-3d43d6f08f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67518e56-0277-44b8-aa98-3d43d6f08f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31489c27-2e07-4e0f-a38a-0d901cd16dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:10 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Volume d3be0b52-78f2-4ad9-90f9-a1b991f811a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9', 'volume_size': 1} Sep 17 17:22:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:13 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414" returned: 0 in 6.634s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG cinder.image.image_utils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Image conversion details: src /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 {{(pid=85889) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 17:22:13 devstack cinder-volume[85889]: INFO cinder.image.image_utils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Converted 1024.00 MB image at 154.32 MB/s Sep 17 17:22:13 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 is being set with open permissions: ugo+rw Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:13 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 Sep 17 17:22:13 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:13 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414" returned: 0 in 0.241s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-09ae2564-ffb9-425e-906b-234711cfa414" released by "_copy_volume_from_snapshot" :: held 7.810s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-c6674dd8-4a2f-48c6-bed3-c2d00d92920f-09ae2564-ffb9-425e-906b-234711cfa414" released by "_create_volume_from_snapshot" :: held 7.895s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.931s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.166s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Creating offline snapshot 550410da-e846-4d3e-a85a-2e233bc5bf75 of volume fd8846ab-8848-4686-a596-2d496bf8c984 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (585cf7f1-4e4e-4c3a-881d-44647f87e36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ae2564-ffb9-425e-906b-234711cfa414', 'volume_size': 1, 'snapshot_id': 'c6674dd8-4a2f-48c6-bed3-c2d00d92920f'}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134dc508-daa7-4dd2-b707-458e444e676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e8fb8a-812d-4787-b2fc-adf1c5d15e63]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:13 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Volume volume-09ae2564-ffb9-425e-906b-234711cfa414 (09ae2564-ffb9-425e-906b-234711cfa414): created successfully Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134dc508-daa7-4dd2-b707-458e444e676e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Flow 'volume_create_manager' (e02eefad-d314-4100-b8ab-d666aa497223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:13 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1f561749-5ed8-4d0c-b42f-925b3db34d89 tempest-SnapshotDependencyTests-318949823 None] Created volume successfully. Sep 17 17:22:13 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 Sep 17 17:22:13 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:13 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984" returned: 0 in 0.350s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:13 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:13 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 1G Sep 17 17:22:13 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "cinder-c6674dd8-4a2f-48c6-bed3-c2d00d92920f-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-c6674dd8-4a2f-48c6-bed3-c2d00d92920f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "cinder-quobyte-a97e8fc0-dad5-498d-895d-82d022191cc6" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-a97e8fc0-dad5-498d-895d-82d022191cc6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "cinder-quobyte-c6674dd8-4a2f-48c6-bed3-c2d00d92920f" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-c6674dd8-4a2f-48c6-bed3-c2d00d92920f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Deleting offline snapshot c6674dd8-4a2f-48c6-bed3-c2d00d92920f of volume a97e8fc0-dad5-498d-895d-82d022191cc6 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] snapshot_file for this snap is: volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b6ecb9-8493-42c3-a7ec-de4d6897fd9a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:14 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 1G" returned: 0 in 0.431s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd8846ab-8848-4686-a596-2d496bf8c984 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:14 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd8846ab-8848-4686-a596-2d496bf8c984 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 Sep 17 17:22:14 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:14 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f Sep 17 17:22:14 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:14 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd8846ab-8848-4686-a596-2d496bf8c984 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75" returned: 0 in 0.289s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:14 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 is being set with open permissions: ugo+rw Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:14 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 Sep 17 17:22:14 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:14 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f" returned: 0 in 0.380s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a97e8fc0-dad5-498d-895d-82d022191cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d62303e-f101-4366-bd0d-c434ec31d0ae]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:14 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 Sep 17 17:22:14 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:14 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75" returned: 0 in 0.258s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:14 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.info Sep 17 17:22:14 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:14 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.info" returned: 0 in 0.251s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:14 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.info is being set with open permissions: ugo+rw Sep 17 17:22:14 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:14 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.info Sep 17 17:22:14 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:15 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6" returned: 0 in 0.556s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:15 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f Sep 17 17:22:15 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:15 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.info" returned: 0 in 0.250s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.420s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606072867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3be0b52-78f2-4ad9-90f9-a1b991f811a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:11Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Creating volume d3be0b52-78f2-4ad9-90f9-a1b991f811a9 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:15 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:15 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 1073741824 Sep 17 17:22:15 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:15 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b2e07ff0-150b-4d06-9049-b51205436f94 tempest-ProjectReaderTests-835462842 None] Create snapshot completed successfully Sep 17 17:22:15 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f" returned: 0 in 0.334s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:15 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f Sep 17 17:22:15 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-550410da-e846-4d3e-a85a-2e233bc5bf75-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Lock "cinder-550410da-e846-4d3e-a85a-2e233bc5bf75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-fd8846ab-8848-4686-a596-2d496bf8c984" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:15 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:15 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6.c6674dd8-4a2f-48c6-bed3-c2d00d92920f" returned: 0 in 0.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 1073741824" returned: 0 in 0.458s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-fd8846ab-8848-4686-a596-2d496bf8c984" acquired by "delete_snapshot" :: waited 0.051s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-550410da-e846-4d3e-a85a-2e233bc5bf75" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-c6674dd8-4a2f-48c6-bed3-c2d00d92920f" released by "_delete_snapshot" :: held 1.669s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-a97e8fc0-dad5-498d-895d-82d022191cc6" released by "delete_snapshot" :: held 1.698s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-550410da-e846-4d3e-a85a-2e233bc5bf75" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Deleting offline snapshot 550410da-e846-4d3e-a85a-2e233bc5bf75 of volume fd8846ab-8848-4686-a596-2d496bf8c984 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] snapshot_file for this snap is: volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf70633-975c-49f2-a9ee-5155d4d669e5]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:15 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 Sep 17 17:22:15 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Created reservations ['724bc80a-a50a-4d22-a71d-aadd68593f59', '63868a66-890d-4391-9b91-d03ab7454cbf', '5a70f3e3-5cc7-40d0-bfb2-e857fa99187c', '61b73a58-53d6-4b35-87c5-3784fab1e822'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:15 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Delete snapshot completed successfully. Sep 17 17:22:15 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ea34dda4-f5a8-4775-8600-48bd7e7e2f20 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-c6674dd8-4a2f-48c6-bed3-c2d00d92920f-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:15 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 Sep 17 17:22:15 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:16 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" returned: 0 in 0.255s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31489c27-2e07-4e0f-a38a-0d901cd16dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b499381-175f-4e06-8c1e-40e880118c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:16 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Volume volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 (d3be0b52-78f2-4ad9-90f9-a1b991f811a9): created successfully Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b499381-175f-4e06-8c1e-40e880118c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (9a71d9c8-695a-48c6-8e21-dd4787502398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:16 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b97d9a83-7d2a-4625-ba95-ad60fd46b516 tempest-ProjectMemberTests-72633776 None] Created volume successfully. Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "cinder-a97e8fc0-dad5-498d-895d-82d022191cc6-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:16 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75" returned: 0 in 0.408s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd8846ab-8848-4686-a596-2d496bf8c984(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-a97e8fc0-dad5-498d-895d-82d022191cc6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea76b9c-34dd-420a-8f21-abbc322a355d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "cinder-quobyte-a97e8fc0-dad5-498d-895d-82d022191cc6" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-a97e8fc0-dad5-498d-895d-82d022191cc6" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84110f1-772a-4fd0-895d-c6ef43c193d9]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:16 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 Sep 17 17:22:16 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:16 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 Sep 17 17:22:16 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:16 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984" returned: 0 in 0.372s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:16 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 Sep 17 17:22:16 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:16 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6" returned: 0 in 0.373s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:16 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6 Sep 17 17:22:16 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:16 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75" returned: 0 in 0.330s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:16 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:16 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-a97e8fc0-dad5-498d-895d-82d022191cc6" returned: 0 in 0.256s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:16 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75 Sep 17 17:22:16 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-a97e8fc0-dad5-498d-895d-82d022191cc6" released by "delete_volume" :: held 0.704s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Created reservations ['53938f97-71a6-4055-af72-d8b42ed01b96', 'cc5a633c-2e9a-41a2-b7f6-c6342306be06', '0246e2ec-df48-4b83-8434-c3ca6b3e8dbf', '14e94483-526e-4c4b-a5e2-b00aae1a70a8'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:17 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:17 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:17 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984.550410da-e846-4d3e-a85a-2e233bc5bf75" returned: 0 in 0.280s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-550410da-e846-4d3e-a85a-2e233bc5bf75" released by "_delete_snapshot" :: held 1.548s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-fd8846ab-8848-4686-a596-2d496bf8c984" released by "delete_snapshot" :: held 1.586s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Creating offline snapshot 50d44ffa-9648-4342-b001-dd94e685db32 of volume d3be0b52-78f2-4ad9-90f9-a1b991f811a9 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44e826d-eb91-4480-be6d-ebe576241721]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "cinder-09ae2564-ffb9-425e-906b-234711cfa414-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:17 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-09ae2564-ffb9-425e-906b-234711cfa414-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.310s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Created reservations ['2d832617-1d45-40e3-ab08-d40d8c01d71e', '50e44401-9096-4fcb-9b41-d63d66a7f8e9', '4fdceb56-9484-44ae-a09f-3a6e1ddc4da4', '25675d58-dc82-4b67-89b1-2546793e5fb3'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:17 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Deleted volume successfully. Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "cinder-quobyte-09ae2564-ffb9-425e-906b-234711cfa414" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-3b3e9278-19e4-4d53-b7b0-7fe79c80af53 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-a97e8fc0-dad5-498d-895d-82d022191cc6-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-09ae2564-ffb9-425e-906b-234711cfa414" acquired by "delete_volume" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:17 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 Sep 17 17:22:17 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:17 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Delete snapshot completed successfully. Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1164f8da-6884-421f-9cd1-c0ffd4cfe4c5]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-cc374939-3e99-4358-a5af-8a807c4a7312 tempest-ProjectReaderTests-835462842 None] Lock "cinder-550410da-e846-4d3e-a85a-2e233bc5bf75-delete_snapshot" released by "delete_snapshot" :: held 1.891s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:17 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 Sep 17 17:22:17 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:17 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" returned: 0 in 0.419s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-fd8846ab-8848-4686-a596-2d496bf8c984-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:17 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 1G Sep 17 17:22:17 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Lock "cinder-fd8846ab-8848-4686-a596-2d496bf8c984-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Acquiring lock "cinder-quobyte-fd8846ab-8848-4686-a596-2d496bf8c984" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-fd8846ab-8848-4686-a596-2d496bf8c984" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:17 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414" returned: 0 in 0.408s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8640dd56-0bec-4847-a1a7-06afc23bd922]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:17 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:17 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414 Sep 17 17:22:17 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:18 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 Sep 17 17:22:18 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:18 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-09ae2564-ffb9-425e-906b-234711cfa414" returned: 0 in 0.278s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-quobyte-09ae2564-ffb9-425e-906b-234711cfa414" released by "delete_volume" :: held 0.738s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:18 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 1G" returned: 0 in 0.463s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:18 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 Sep 17 17:22:18 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Created reservations ['d1bab79c-edde-4505-a04b-ffcef9cc5e6d', '255929fa-8fa2-483d-9b88-b53659cfdca8', '32c7dca9-366d-49eb-b38d-331dbcbe6e57', 'c4723e2f-3b4e-4b8a-845b-03dd72454d1a'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:18 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984" returned: 0 in 0.437s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:18 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:18 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:18 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984 Sep 17 17:22:18 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:18 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32" returned: 0 in 0.351s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:18 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 is being set with open permissions: ugo+rw Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:18 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 Sep 17 17:22:18 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:18 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.287s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:18 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Deleted volume successfully. Sep 17 17:22:18 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-fd8846ab-8848-4686-a596-2d496bf8c984" returned: 0 in 0.293s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Lock "cinder-quobyte-fd8846ab-8848-4686-a596-2d496bf8c984" released by "delete_volume" :: held 0.803s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-1caf3907-ed28-4bff-90bd-9ded0fe352b2 tempest-SnapshotDependencyTests-318949823 None] Lock "cinder-09ae2564-ffb9-425e-906b-234711cfa414-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Created reservations ['b1811c2c-8ec3-476b-baef-fd8539f5dc2f', '44c14339-9ccd-4063-a511-75ee2e791758', 'c93218cf-6178-4703-b355-9ed83dcb8e25', 'b9afe120-7a05-4f02-837d-a321d618d604'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:18 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:18 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:18 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32" returned: 0 in 0.297s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:18 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:18 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.info Sep 17 17:22:18 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:19 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.315s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:19 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Deleted volume successfully. Sep 17 17:22:19 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fcb3cba5-a952-40d8-ac95-93020ebcd2ae tempest-ProjectReaderTests-835462842 None] Lock "cinder-fd8846ab-8848-4686-a596-2d496bf8c984-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:19 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.info" returned: 0 in 0.293s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:19 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.info is being set with open permissions: ugo+rw Sep 17 17:22:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:19 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.info Sep 17 17:22:19 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:19 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.info" returned: 0 in 0.292s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:19 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:19 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-381cfbce-bd73-4faf-bc54-8ee56a3fc2e1 tempest-ProjectMemberTests-72633776 None] Create snapshot completed successfully Sep 17 17:22:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-50d44ffa-9648-4342-b001-dd94e685db32-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Lock "cinder-50d44ffa-9648-4342-b001-dd94e685db32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-50d44ffa-9648-4342-b001-dd94e685db32" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:20 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-50d44ffa-9648-4342-b001-dd94e685db32" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Deleting offline snapshot 50d44ffa-9648-4342-b001-dd94e685db32 of volume d3be0b52-78f2-4ad9-90f9-a1b991f811a9 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:22:20 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] snapshot_file for this snap is: volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:22:20 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57ba7af-5e2c-40d3-a54d-013c12f18900]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:20 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:20 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 Sep 17 17:22:20 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:21 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32" returned: 0 in 0.403s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:21 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:22:21 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6ecdd0-abea-4cd9-9542-cda4dab58604]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:21 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 Sep 17 17:22:21 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:21 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" returned: 0 in 0.419s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:21 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 Sep 17 17:22:21 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:21 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32" returned: 0 in 0.392s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:21 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:21 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32 Sep 17 17:22:21 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:22 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9.50d44ffa-9648-4342-b001-dd94e685db32" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-50d44ffa-9648-4342-b001-dd94e685db32" released by "_delete_snapshot" :: held 1.608s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" released by "delete_snapshot" :: held 1.643s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Created reservations ['8e0c5898-16ce-489d-b5ab-f712299e93e1', 'cc3b5cb0-6201-425f-a4c4-8025c7c6a8d2', '352fdeb0-9d1e-465c-b4cc-cc50463a7223', 'ba149d37-1988-47e6-bfe0-a2b6b8ab7b8d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:22 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Delete snapshot completed successfully. Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-690c7d08-2a9d-48f3-83c6-89655622be8e tempest-ProjectMemberTests-72633776 None] Lock "cinder-50d44ffa-9648-4342-b001-dd94e685db32-delete_snapshot" released by "delete_snapshot" :: held 1.818s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:22 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:22 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:22 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.253s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-d3be0b52-78f2-4ad9-90f9-a1b991f811a9-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Lock "cinder-d3be0b52-78f2-4ad9-90f9-a1b991f811a9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" acquired by "delete_volume" :: waited 0.042s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f42ad9-802b-4b63-b4bf-691142a7f8f6]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:23 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 Sep 17 17:22:23 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:23 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" returned: 0 in 0.432s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:23 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9 Sep 17 17:22:23 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:23 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" returned: 0 in 0.290s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d3be0b52-78f2-4ad9-90f9-a1b991f811a9" released by "delete_volume" :: held 0.823s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Created reservations ['c7ef4682-8a90-4f0d-b73e-2b51f5872cdf', 'c8f80026-cf24-40b7-98e4-def1d1476854', 'cc55d2c7-167a-4065-bffb-5c965b223a0d', '25e90c80-d5a6-4bcb-9da8-0bf99b5b89a6'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:23 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:23 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:23 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:24 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.336s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:24 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Deleted volume successfully. Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-82984bf5-d34a-469f-aff5-918f68f0850f tempest-ProjectMemberTests-72633776 None] Lock "cinder-d3be0b52-78f2-4ad9-90f9-a1b991f811a9-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (dcb9b1c5-e7ef-41fb-9009-d59f7da97326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91476485-f294-456b-b778-0c65a73a738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91476485-f294-456b-b778-0c65a73a738b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-112127882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75c354f-477b-4a95-bf38-4b3e92d27743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:25Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7899b75d-c146-44b0-ad1a-abd532981370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7899b75d-c146-44b0-ad1a-abd532981370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d7f771-fe2a-4c7c-a3da-a81cb16f421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d7f771-fe2a-4c7c-a3da-a81cb16f421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75c354f-477b-4a95-bf38-4b3e92d27743', 'volume_name': 'volume-d75c354f-477b-4a95-bf38-4b3e92d27743', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454c798f-a887-4091-9a59-dc6d62d0e619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454c798f-a887-4091-9a59-dc6d62d0e619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643f4a8f-cce1-4338-9e38-cdfa697da3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:24 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Volume d75c354f-477b-4a95-bf38-4b3e92d27743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75c354f-477b-4a95-bf38-4b3e92d27743', 'volume_size': 1} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-112127882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75c354f-477b-4a95-bf38-4b3e92d27743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:25Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Creating volume d75c354f-477b-4a95-bf38-4b3e92d27743 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:24 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:22:24 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:24 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 1073741824 Sep 17 17:22:24 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:25 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 1073741824" returned: 0 in 0.527s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:25 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 Sep 17 17:22:25 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:25 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743" returned: 0 in 0.272s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:25 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:25 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643f4a8f-cce1-4338-9e38-cdfa697da3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75c354f-477b-4a95-bf38-4b3e92d27743', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6215c2e8-ae43-4dfe-a16f-439a221eca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:25 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Volume volume-d75c354f-477b-4a95-bf38-4b3e92d27743 (d75c354f-477b-4a95-bf38-4b3e92d27743): created successfully Sep 17 17:22:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6215c2e8-ae43-4dfe-a16f-439a221eca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:25 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (dcb9b1c5-e7ef-41fb-9009-d59f7da97326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:25 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-facaaf59-b8db-4255-875e-ca0684fbc925 tempest-ProjectMemberTests-72633776 None] Created volume successfully. Sep 17 17:22:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:26 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Creating offline snapshot 13572d74-027a-4ee4-8048-aebcdbb74a84 of volume d75c354f-477b-4a95-bf38-4b3e92d27743 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:22:26 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bece89e-533d-4568-bf50-9bc5b7f57406]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:26 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:27 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 Sep 17 17:22:27 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:27 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743" returned: 0 in 0.386s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:27 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 1G Sep 17 17:22:27 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:27 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 1G" returned: 0 in 0.600s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:27 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d75c354f-477b-4a95-bf38-4b3e92d27743 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:27 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d75c354f-477b-4a95-bf38-4b3e92d27743 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 Sep 17 17:22:27 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Flow 'volume_create_manager' (ee6be458-7594-44d6-8381-1a50ba00f0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061b8d63-d57f-4076-bcf9-2b60ef332554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061b8d63-d57f-4076-bcf9-2b60ef332554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107920676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4647a4-a954-41ae-86e0-13fcbe28357a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c85a56a91624c5a9cec5871079a7e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:28Z,use_quota=True,user_id='9493d4dc38ff4044b4ba23377d7a4c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf3aa21-1799-421c-8d0d-4169f7e87eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf3aa21-1799-421c-8d0d-4169f7e87eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3828f4-9a70-4538-8a91-4cf1f2ab84f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3828f4-9a70-4538-8a91-4cf1f2ab84f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d4647a4-a954-41ae-86e0-13fcbe28357a', 'volume_name': 'volume-0d4647a4-a954-41ae-86e0-13fcbe28357a', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d40e90-0434-4127-8f52-ab12781524af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d40e90-0434-4127-8f52-ab12781524af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce3ac4f-6a90-4503-89b6-2718284a95ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:28 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Volume 0d4647a4-a954-41ae-86e0-13fcbe28357a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d4647a4-a954-41ae-86e0-13fcbe28357a', 'volume_size': 1} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:28 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d75c354f-477b-4a95-bf38-4b3e92d27743 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84" returned: 0 in 0.337s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:28 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 is being set with open permissions: ugo+rw Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:28 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 Sep 17 17:22:28 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:28 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84" returned: 0 in 0.261s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:28 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.info Sep 17 17:22:28 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:28 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.info" returned: 0 in 0.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:28 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.info is being set with open permissions: ugo+rw Sep 17 17:22:28 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:28 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.info Sep 17 17:22:28 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:29 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.info" returned: 0 in 0.264s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107920676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4647a4-a954-41ae-86e0-13fcbe28357a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c85a56a91624c5a9cec5871079a7e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:28Z,use_quota=True,user_id='9493d4dc38ff4044b4ba23377d7a4c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Creating volume 0d4647a4-a954-41ae-86e0-13fcbe28357a {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:29 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:29 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a 1073741824 Sep 17 17:22:29 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:29 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-d374b00f-dc38-4dd8-b2f8-8a54e890b6e0 tempest-ProjectMemberTests-72633776 None] Create snapshot completed successfully Sep 17 17:22:29 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a 1073741824" returned: 0 in 0.517s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:29 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a Sep 17 17:22:29 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:29 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a" returned: 0 in 0.273s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=216,cinder:SELECT=166,cinder:INSERT=53,cinder:DELETE=14 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:22:29 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce3ac4f-6a90-4503-89b6-2718284a95ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d4647a4-a954-41ae-86e0-13fcbe28357a', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c09fb2e-474c-49fb-bd98-064b3a99fc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:SELECT=171,cinder:INSERT=63,cinder:DELETE=21,cinder:UPDATE=202 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:22:30 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Volume volume-0d4647a4-a954-41ae-86e0-13fcbe28357a (0d4647a4-a954-41ae-86e0-13fcbe28357a): created successfully Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c09fb2e-474c-49fb-bd98-064b3a99fc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Flow 'volume_create_manager' (ee6be458-7594-44d6-8381-1a50ba00f0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:30 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-98a83881-8e25-46d3-adbb-635d18f71e5d tempest-ProjectReaderTests-785865324 None] Created volume successfully. Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-13572d74-027a-4ee4-8048-aebcdbb74a84-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Lock "cinder-13572d74-027a-4ee4-8048-aebcdbb74a84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-d75c354f-477b-4a95-bf38-4b3e92d27743" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d75c354f-477b-4a95-bf38-4b3e92d27743" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-13572d74-027a-4ee4-8048-aebcdbb74a84" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-13572d74-027a-4ee4-8048-aebcdbb74a84" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Deleting offline snapshot 13572d74-027a-4ee4-8048-aebcdbb74a84 of volume d75c354f-477b-4a95-bf38-4b3e92d27743 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] snapshot_file for this snap is: volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55bc48b-a9d0-452c-8ab9-9e014cb4cd4d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:30 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 Sep 17 17:22:30 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Acquiring lock "cinder-0d4647a4-a954-41ae-86e0-13fcbe28357a-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Lock "cinder-0d4647a4-a954-41ae-86e0-13fcbe28357a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Acquiring lock "cinder-quobyte-0d4647a4-a954-41ae-86e0-13fcbe28357a" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Lock "cinder-quobyte-0d4647a4-a954-41ae-86e0-13fcbe28357a" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff01de-7f2c-4e53-8b68-18eabf9813f7]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:30 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84" returned: 0 in 0.457s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d75c354f-477b-4a95-bf38-4b3e92d27743(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beef7b6-74cf-4885-9ecb-30d817ab0766]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:30 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:30 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a Sep 17 17:22:30 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:30 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 Sep 17 17:22:30 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:31 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a" returned: 0 in 0.393s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:31 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743" returned: 0 in 0.376s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:31 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a Sep 17 17:22:31 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:31 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 Sep 17 17:22:31 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:31 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-0d4647a4-a954-41ae-86e0-13fcbe28357a" returned: 0 in 0.270s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Lock "cinder-quobyte-0d4647a4-a954-41ae-86e0-13fcbe28357a" released by "delete_volume" :: held 0.714s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Created reservations ['16070bfe-0416-43f7-8f91-dd8671df479d', '3e432e7d-8319-41fe-9e2e-89cfc5ace64f', '7024cc03-ca06-47c6-8441-8d920412bc62', '0cce0d3d-de6e-4116-b84f-2931eeca559b'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:31 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84" returned: 0 in 0.362s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:31 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84 Sep 17 17:22:31 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:31 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:31 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:31 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743.13572d74-027a-4ee4-8048-aebcdbb74a84" returned: 0 in 0.265s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:31 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.262s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-13572d74-027a-4ee4-8048-aebcdbb74a84" released by "_delete_snapshot" :: held 1.574s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Deleted volume successfully. Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d75c354f-477b-4a95-bf38-4b3e92d27743" released by "delete_snapshot" :: held 1.604s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6d0d7885-c98a-458d-93f4-b6da4ec9411e tempest-ProjectReaderTests-785865324 None] Lock "cinder-0d4647a4-a954-41ae-86e0-13fcbe28357a-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Created reservations ['2ae91561-0c9f-46b6-b7e1-c10c49872e67', 'caae5692-0673-4ac0-884d-aa9913b84da0', '2f40dcf1-cf33-44ac-a8e0-dff45a7c0db3', '11668ded-0afa-4252-bbb1-862080756ee9'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:31 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Delete snapshot completed successfully. Sep 17 17:22:31 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-62272292-f462-4d77-a5cf-14d81e7d2f7b tempest-ProjectMemberTests-72633776 None] Lock "cinder-13572d74-027a-4ee4-8048-aebcdbb74a84-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Flow 'volume_create_manager' (faabdc2a-415e-49a7-99c5-ae741bd34dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45c7be1-fb94-4b5d-aa7b-e4c43a2fc440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45c7be1-fb94-4b5d-aa7b-e4c43a2fc440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822075661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b782e87b-68e6-4b12-ad63-3fd9f43be88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c85a56a91624c5a9cec5871079a7e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:32Z,use_quota=True,user_id='9493d4dc38ff4044b4ba23377d7a4c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e69c08-4b91-4cf1-ad0a-47bdbee3d7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e69c08-4b91-4cf1-ad0a-47bdbee3d7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8897483e-7da1-4dfa-a71d-d4b5411d947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8897483e-7da1-4dfa-a71d-d4b5411d947c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b782e87b-68e6-4b12-ad63-3fd9f43be88a', 'volume_name': 'volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5b759a-f003-4dc6-9129-09f50c3e5189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5b759a-f003-4dc6-9129-09f50c3e5189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2645481-6233-4280-96a9-42cee4017f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:32 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Volume b782e87b-68e6-4b12-ad63-3fd9f43be88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a', 'volume_size': 1} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822075661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b782e87b-68e6-4b12-ad63-3fd9f43be88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c85a56a91624c5a9cec5871079a7e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:32Z,use_quota=True,user_id='9493d4dc38ff4044b4ba23377d7a4c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Creating volume b782e87b-68e6-4b12-ad63-3fd9f43be88a {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:32 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-d75c354f-477b-4a95-bf38-4b3e92d27743-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:32 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a 1073741824 Sep 17 17:22:32 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Lock "cinder-d75c354f-477b-4a95-bf38-4b3e92d27743-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-d75c354f-477b-4a95-bf38-4b3e92d27743" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d75c354f-477b-4a95-bf38-4b3e92d27743" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ead82-646c-48fa-98e8-2c33dab9bb02]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:32 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 Sep 17 17:22:32 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:32 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a 1073741824" returned: 0 in 0.434s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:32 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a Sep 17 17:22:32 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:32 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743" returned: 0 in 0.377s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:32 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:32 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743 Sep 17 17:22:32 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:33 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a" returned: 0 in 0.249s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2645481-6233-4280-96a9-42cee4017f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34351c58-2cc8-49c4-9854-5e74c2486ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:33 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Volume volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a (b782e87b-68e6-4b12-ad63-3fd9f43be88a): created successfully Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34351c58-2cc8-49c4-9854-5e74c2486ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Flow 'volume_create_manager' (faabdc2a-415e-49a7-99c5-ae741bd34dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:33 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-d75c354f-477b-4a95-bf38-4b3e92d27743" returned: 0 in 0.257s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:33 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b818718c-7ca1-4550-b5ba-4894f1bfda0d tempest-ProjectReaderTests-785865324 None] Created volume successfully. Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-d75c354f-477b-4a95-bf38-4b3e92d27743" released by "delete_volume" :: held 0.697s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Created reservations ['83ac621f-471f-487b-a266-932d94ebcadd', '796e1d76-1342-42f7-a24f-5ee6e69e9006', 'ad9e91aa-a5c6-4ae8-98c5-b43b40db2ffa', '82be1100-1271-4889-a796-71bb17ba3b3d'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:33 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:33 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Acquiring lock "cinder-b782e87b-68e6-4b12-ad63-3fd9f43be88a-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Lock "cinder-b782e87b-68e6-4b12-ad63-3fd9f43be88a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Acquiring lock "cinder-quobyte-b782e87b-68e6-4b12-ad63-3fd9f43be88a" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Lock "cinder-quobyte-b782e87b-68e6-4b12-ad63-3fd9f43be88a" acquired by "delete_volume" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[388d03a5-11d0-45c5-a730-7667399ecbe4]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:33 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.269s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:33 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Deleted volume successfully. Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-b2975783-4e88-4884-b6a8-ffd1f19ee9f7 tempest-ProjectMemberTests-72633776 None] Lock "cinder-d75c354f-477b-4a95-bf38-4b3e92d27743-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:33 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a Sep 17 17:22:33 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:33 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a" returned: 0 in 0.387s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:33 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:33 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a Sep 17 17:22:33 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (011fb17f-5404-41c1-9930-503305f52600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416846bc-9452-4b7f-abc0-2cf7e61ea4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:34 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416846bc-9452-4b7f-abc0-2cf7e61ea4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2099624779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0bf980-ebf3-4717-a5d6-eaef8ee51297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:34Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a4f1ec-3786-45d3-9d4b-80b6ec226b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a4f1ec-3786-45d3-9d4b-80b6ec226b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa2d79c-38ac-46d2-865a-3ed9b8a0a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa2d79c-38ac-46d2-865a-3ed9b8a0a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d0bf980-ebf3-4717-a5d6-eaef8ee51297', 'volume_name': 'volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f80f14a-89fd-4abf-9c03-cded1df1922d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f80f14a-89fd-4abf-9c03-cded1df1922d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810e31f0-6cb3-4432-926d-1bbf88c7aef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:34 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Volume 6d0bf980-ebf3-4717-a5d6-eaef8ee51297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297', 'volume_size': 1} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2099624779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0bf980-ebf3-4717-a5d6-eaef8ee51297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:34Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Creating volume 6d0bf980-ebf3-4717-a5d6-eaef8ee51297 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:34 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-b782e87b-68e6-4b12-ad63-3fd9f43be88a" returned: 0 in 0.316s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:34 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 1073741824 Sep 17 17:22:34 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Lock "cinder-quobyte-b782e87b-68e6-4b12-ad63-3fd9f43be88a" released by "delete_volume" :: held 0.749s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Created reservations ['28015f35-17f4-4864-8ab5-ed88208f4ad0', 'de47a769-7387-4151-b1fc-b8d8f3c1f729', '0127902a-4d2b-443c-86bd-876ca94a12f9', '2a6ca82a-c3b9-47de-98b8-45967c8db1b6'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:34 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:34 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:34 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.273s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Deleted volume successfully. Sep 17 17:22:34 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 1073741824" returned: 0 in 0.444s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-56d1037b-2a54-4a36-a462-28e0bce2accd tempest-ProjectReaderTests-785865324 None] Lock "cinder-b782e87b-68e6-4b12-ad63-3fd9f43be88a-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:34 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 Sep 17 17:22:34 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:34 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" returned: 0 in 0.260s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810e31f0-6cb3-4432-926d-1bbf88c7aef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e50510-4d5e-4578-a140-ab6a58fc725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:34 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Volume volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 (6d0bf980-ebf3-4717-a5d6-eaef8ee51297): created successfully Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e50510-4d5e-4578-a140-ab6a58fc725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (011fb17f-5404-41c1-9930-503305f52600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:34 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4b311b1e-6245-49e3-9387-196001f66c29 tempest-ProjectMemberTests-72633776 None] Created volume successfully. Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Flow 'volume_create_manager' (4b133db9-597d-41c9-9711-c2ab59509805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:34 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f596306b-9271-4d7e-8d07-8d21bea7ee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f596306b-9271-4d7e-8d07-8d21bea7ee6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058168110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f46abe-31c1-4e21-9e2a-927bc885eabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c85a56a91624c5a9cec5871079a7e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:35Z,use_quota=True,user_id='9493d4dc38ff4044b4ba23377d7a4c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003f61a0-baf5-4d58-8f96-2d22f2c29197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003f61a0-baf5-4d58-8f96-2d22f2c29197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a092663-7efa-4f77-8138-37c51e39aa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a092663-7efa-4f77-8138-37c51e39aa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f46abe-31c1-4e21-9e2a-927bc885eabe', 'volume_name': 'volume-32f46abe-31c1-4e21-9e2a-927bc885eabe', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580c4fa8-d122-4635-8f65-8cb1e752500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580c4fa8-d122-4635-8f65-8cb1e752500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4b6159-c1eb-4c83-87d5-4e5fd4b04560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:35 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Volume 32f46abe-31c1-4e21-9e2a-927bc885eabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f46abe-31c1-4e21-9e2a-927bc885eabe', 'volume_size': 1} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058168110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f46abe-31c1-4e21-9e2a-927bc885eabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c85a56a91624c5a9cec5871079a7e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:35Z,use_quota=True,user_id='9493d4dc38ff4044b4ba23377d7a4c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Creating volume 32f46abe-31c1-4e21-9e2a-927bc885eabe {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:35 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:35 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe 1073741824 Sep 17 17:22:35 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:35 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe 1073741824" returned: 0 in 0.439s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:35 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe Sep 17 17:22:35 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:35 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe" returned: 0 in 0.243s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.553s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4b6159-c1eb-4c83-87d5-4e5fd4b04560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f46abe-31c1-4e21-9e2a-927bc885eabe', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81894a8d-8507-4732-ac35-85d4bd477dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Creating offline snapshot a610e51e-fe02-4a6c-b03f-85a065a2e1aa of volume 6d0bf980-ebf3-4717-a5d6-eaef8ee51297 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:22:35 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Volume volume-32f46abe-31c1-4e21-9e2a-927bc885eabe (32f46abe-31c1-4e21-9e2a-927bc885eabe): created successfully Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81894a8d-8507-4732-ac35-85d4bd477dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Flow 'volume_create_manager' (4b133db9-597d-41c9-9711-c2ab59509805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4e12e1-7077-4af7-b163-195d23706d87]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:35 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:35 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ea4927eb-7d4b-4121-ba31-dbf8c0760ae9 tempest-ProjectReaderTests-785865324 None] Created volume successfully. Sep 17 17:22:35 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 Sep 17 17:22:35 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Acquiring lock "cinder-32f46abe-31c1-4e21-9e2a-927bc885eabe-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Lock "cinder-32f46abe-31c1-4e21-9e2a-927bc885eabe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Acquiring lock "cinder-quobyte-32f46abe-31c1-4e21-9e2a-927bc885eabe" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Lock "cinder-quobyte-32f46abe-31c1-4e21-9e2a-927bc885eabe" acquired by "delete_volume" :: waited 0.020s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[83201b8c-5762-4e24-9e31-2131a7973ea4]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:36 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" returned: 0 in 0.369s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:36 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa 1G Sep 17 17:22:36 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:36 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe Sep 17 17:22:36 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:36 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe" returned: 0 in 0.377s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:36 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe Sep 17 17:22:36 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:36 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa 1G" returned: 0 in 0.401s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:36 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa Sep 17 17:22:36 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:36 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-32f46abe-31c1-4e21-9e2a-927bc885eabe" returned: 0 in 0.247s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Lock "cinder-quobyte-32f46abe-31c1-4e21-9e2a-927bc885eabe" released by "delete_volume" :: held 0.672s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Created reservations ['323a6fa1-c69c-4074-aa7b-5feb98fdede7', 'ad38760a-c13d-4516-8717-d858c51f8465', '872c7288-37bc-4de6-b399-bc736d32713e', '6d04c9f5-5a9e-4710-8231-f3613e7c3bad'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:36 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa" returned: 0 in 0.324s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:36 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa is being set with open permissions: ugo+rw Sep 17 17:22:36 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:36 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:36 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:36 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa Sep 17 17:22:36 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:37 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.269s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Deleted volume successfully. Sep 17 17:22:37 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa" returned: 0 in 0.272s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-30e4cf42-48a8-47ab-b375-bc3c27bd49dc tempest-ProjectReaderTests-785865324 None] Lock "cinder-32f46abe-31c1-4e21-9e2a-927bc885eabe-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:37 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.info Sep 17 17:22:37 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:37 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.info" returned: 0 in 0.270s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:37 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.info is being set with open permissions: ugo+rw Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:37 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.info Sep 17 17:22:37 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Flow 'volume_create_manager' (c78692dd-b321-48a4-9d46-1227d32ff4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafce26d-9e18-41f0-8214-1dd1513652c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafce26d-9e18-41f0-8214-1dd1513652c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206225744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffcebc95-7122-4c00-9c19-89ac4394ea3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c85a56a91624c5a9cec5871079a7e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:38Z,use_quota=True,user_id='9493d4dc38ff4044b4ba23377d7a4c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1929ba38-acde-4dfd-a560-fb263e60b6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1929ba38-acde-4dfd-a560-fb263e60b6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d3cb7c-a9a0-417a-aa4f-38f2aa192353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d3cb7c-a9a0-417a-aa4f-38f2aa192353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffcebc95-7122-4c00-9c19-89ac4394ea3d', 'volume_name': 'volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347c6007-5479-4ff0-87e1-a1ff99ee4f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347c6007-5479-4ff0-87e1-a1ff99ee4f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c99327-847f-433d-939a-613a05d6c2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:37 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:37 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Volume ffcebc95-7122-4c00-9c19-89ac4394ea3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d', 'volume_size': 1} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.info" returned: 0 in 0.241s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206225744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffcebc95-7122-4c00-9c19-89ac4394ea3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c85a56a91624c5a9cec5871079a7e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:38Z,use_quota=True,user_id='9493d4dc38ff4044b4ba23377d7a4c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Creating volume ffcebc95-7122-4c00-9c19-89ac4394ea3d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:37 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:22:37 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:37 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d 1073741824 Sep 17 17:22:37 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:37 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-0c815722-273e-4220-bb43-0ec8b7748feb tempest-ProjectMemberTests-72633776 None] Create snapshot completed successfully Sep 17 17:22:38 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d 1073741824" returned: 0 in 0.404s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:38 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d Sep 17 17:22:38 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-a610e51e-fe02-4a6c-b03f-85a065a2e1aa-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Lock "cinder-a610e51e-fe02-4a6c-b03f-85a065a2e1aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-a610e51e-fe02-4a6c-b03f-85a065a2e1aa" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-a610e51e-fe02-4a6c-b03f-85a065a2e1aa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Deleting offline snapshot a610e51e-fe02-4a6c-b03f-85a065a2e1aa of volume 6d0bf980-ebf3-4717-a5d6-eaef8ee51297 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:22:38 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] snapshot_file for this snap is: volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d" returned: 0 in 0.271s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c99327-847f-433d-939a-613a05d6c2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579f4e2d-0056-4552-8569-d0dd2d85f880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca8b0fe-7952-496a-a1bd-27515ba43703]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:38 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Volume volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d (ffcebc95-7122-4c00-9c19-89ac4394ea3d): created successfully Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579f4e2d-0056-4552-8569-d0dd2d85f880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Flow 'volume_create_manager' (c78692dd-b321-48a4-9d46-1227d32ff4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:38 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-25382d07-72fc-4230-bbb2-f0913f6c50ec tempest-ProjectReaderTests-785865324 None] Created volume successfully. Sep 17 17:22:38 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa Sep 17 17:22:38 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Acquiring lock "cinder-ffcebc95-7122-4c00-9c19-89ac4394ea3d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Lock "cinder-ffcebc95-7122-4c00-9c19-89ac4394ea3d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Acquiring lock "cinder-quobyte-ffcebc95-7122-4c00-9c19-89ac4394ea3d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Lock "cinder-quobyte-ffcebc95-7122-4c00-9c19-89ac4394ea3d" acquired by "delete_volume" :: waited 0.016s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5053e1ad-c876-4975-83e2-301d89ca3a52]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:38 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa" returned: 0 in 0.381s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[602c5fbf-9c76-473e-84d3-991eb3700151]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:38 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:38 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d Sep 17 17:22:38 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:39 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 Sep 17 17:22:39 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:39 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d" returned: 0 in 0.380s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:39 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d Sep 17 17:22:39 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:39 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" returned: 0 in 0.374s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:39 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa Sep 17 17:22:39 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:39 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-ffcebc95-7122-4c00-9c19-89ac4394ea3d" returned: 0 in 0.252s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Lock "cinder-quobyte-ffcebc95-7122-4c00-9c19-89ac4394ea3d" released by "delete_volume" :: held 0.674s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Created reservations ['b5672552-2832-45dc-9a7b-1b99b6c08dc6', '3e72228f-5c39-4ea9-b723-91a7988c571e', '41a160e3-8568-4056-a332-701c446bcaac', '7f344408-6397-4e07-b5c5-5c1b62d400da'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:39 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:39 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:39 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa" returned: 0 in 0.368s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:39 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa Sep 17 17:22:39 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:39 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.257s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:39 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Deleted volume successfully. Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5dfea886-f0c9-4d19-a3bb-d63751c7e7e3 tempest-ProjectReaderTests-785865324 None] Lock "cinder-ffcebc95-7122-4c00-9c19-89ac4394ea3d-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:39 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297.a610e51e-fe02-4a6c-b03f-85a065a2e1aa" returned: 0 in 0.260s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-a610e51e-fe02-4a6c-b03f-85a065a2e1aa" released by "_delete_snapshot" :: held 1.507s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:39 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" released by "delete_snapshot" :: held 1.530s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:40 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Created reservations ['ddad214f-d4d3-4682-b423-bcbf8c0966a4', '66bc5c2c-b4ca-4267-8eab-b3ac40a4a9cd', '1e68383d-3809-4dec-9834-cd1050f0410c', 'e4e225fe-40d5-4bb2-9ba3-b0188a9bc47e'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:40 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Delete snapshot completed successfully. Sep 17 17:22:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-5cc906e2-81c1-4a2e-9d90-f04b7fa51a02 tempest-ProjectMemberTests-72633776 None] Lock "cinder-a610e51e-fe02-4a6c-b03f-85a065a2e1aa-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-6d0bf980-ebf3-4717-a5d6-eaef8ee51297-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Lock "cinder-6d0bf980-ebf3-4717-a5d6-eaef8ee51297-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:40 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" acquired by "delete_volume" :: waited 0.023s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:40 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[da015022-c279-46df-9181-8b5cbb252d85]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:40 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:40 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 Sep 17 17:22:40 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:41 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" returned: 0 in 0.406s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:41 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297 Sep 17 17:22:41 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:41 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" returned: 0 in 0.274s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-6d0bf980-ebf3-4717-a5d6-eaef8ee51297" released by "delete_volume" :: held 0.770s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Created reservations ['06482df6-a071-4803-b4b9-869d7f0a8be3', 'c187a113-ea86-40ce-9605-0a46024d486b', 'a0c54322-8ed7-4f49-a04a-4f434a4bf941', '7365b797-ecd8-4290-91f9-b501aedf7956'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:41 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:41 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:41 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.249s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:41 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Deleted volume successfully. Sep 17 17:22:41 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-4d507cda-9730-4c8c-8566-210bb548008e tempest-ProjectMemberTests-72633776 None] Lock "cinder-6d0bf980-ebf3-4717-a5d6-eaef8ee51297-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (efd5a53f-bf83-432a-b320-90182990a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f60c6b6-ad3a-4ad1-9eec-1a8f90652473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f60c6b6-ad3a-4ad1-9eec-1a8f90652473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691711166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753fceba-7a71-4968-abd2-73e757b14963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:42Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12ee823-b788-4eef-b145-3460db32dad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12ee823-b788-4eef-b145-3460db32dad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f2500f-41a7-4362-a8b3-1bee5b333f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f2500f-41a7-4362-a8b3-1bee5b333f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753fceba-7a71-4968-abd2-73e757b14963', 'volume_name': 'volume-753fceba-7a71-4968-abd2-73e757b14963', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6398a76c-a7ce-40be-a6be-94900e3ba18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6398a76c-a7ce-40be-a6be-94900e3ba18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9793a706-9ef5-40d1-b981-ad26d31a8c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:42 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Volume 753fceba-7a71-4968-abd2-73e757b14963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753fceba-7a71-4968-abd2-73e757b14963', 'volume_size': 1} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691711166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753fceba-7a71-4968-abd2-73e757b14963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:42Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Creating volume 753fceba-7a71-4968-abd2-73e757b14963 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:42 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:42 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 1073741824 Sep 17 17:22:42 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:42 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 1073741824" returned: 0 in 0.404s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:42 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 Sep 17 17:22:42 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:42 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963" returned: 0 in 0.237s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9793a706-9ef5-40d1-b981-ad26d31a8c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753fceba-7a71-4968-abd2-73e757b14963', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242fefcc-9c27-40a0-99bd-63ac0021f6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:42 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Volume volume-753fceba-7a71-4968-abd2-73e757b14963 (753fceba-7a71-4968-abd2-73e757b14963): created successfully Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242fefcc-9c27-40a0-99bd-63ac0021f6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:42 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (efd5a53f-bf83-432a-b320-90182990a414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:42 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-120bd1d7-619b-4f7f-af3c-0e79e7790a30 tempest-ProjectMemberTests-72633776 None] Created volume successfully. Sep 17 17:22:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:43 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Creating offline snapshot 20dc1e2f-0b0f-4aea-9480-82aaaeab6206 of volume 753fceba-7a71-4968-abd2-73e757b14963 {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:22:43 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa674ba8-add5-466e-abc6-bb92e0b86b81]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:43 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 Sep 17 17:22:43 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:43 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963" returned: 0 in 0.355s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:43 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:43 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 1G Sep 17 17:22:43 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:44 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 1G" returned: 0 in 0.380s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753fceba-7a71-4968-abd2-73e757b14963 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:44 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753fceba-7a71-4968-abd2-73e757b14963 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 Sep 17 17:22:44 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:44 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753fceba-7a71-4968-abd2-73e757b14963 -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206" returned: 0 in 0.290s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:44 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 is being set with open permissions: ugo+rw Sep 17 17:22:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:44 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 Sep 17 17:22:44 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:44 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206" returned: 0 in 0.236s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:44 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.info Sep 17 17:22:44 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:44 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.info" returned: 0 in 0.253s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:44 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.info is being set with open permissions: ugo+rw Sep 17 17:22:44 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:44 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.info Sep 17 17:22:44 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:45 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.info" returned: 0 in 0.243s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:45 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-bef906ac-e5a9-46d8-8372-06d6eae4f3f7 tempest-ProjectMemberTests-72633776 None] Create snapshot completed successfully Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-20dc1e2f-0b0f-4aea-9480-82aaaeab6206-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Lock "cinder-20dc1e2f-0b0f-4aea-9480-82aaaeab6206-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-753fceba-7a71-4968-abd2-73e757b14963" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-753fceba-7a71-4968-abd2-73e757b14963" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-20dc1e2f-0b0f-4aea-9480-82aaaeab6206" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-20dc1e2f-0b0f-4aea-9480-82aaaeab6206" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Deleting offline snapshot 20dc1e2f-0b0f-4aea-9480-82aaaeab6206 of volume 753fceba-7a71-4968-abd2-73e757b14963 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] snapshot_file for this snap is: volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b7eb09-f313-42da-b0ee-8616651bcf4c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:45 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 Sep 17 17:22:45 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:45 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206" returned: 0 in 0.360s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-753fceba-7a71-4968-abd2-73e757b14963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f0c8b2-3f2e-4e0e-8233-c947149fed7e]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:45 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:46 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 Sep 17 17:22:46 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:46 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963" returned: 0 in 0.352s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:46 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 Sep 17 17:22:46 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:46 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206" returned: 0 in 0.327s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:46 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206 Sep 17 17:22:46 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:46 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:46 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963.20dc1e2f-0b0f-4aea-9480-82aaaeab6206" returned: 0 in 0.240s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-20dc1e2f-0b0f-4aea-9480-82aaaeab6206" released by "_delete_snapshot" :: held 1.368s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-753fceba-7a71-4968-abd2-73e757b14963" released by "delete_snapshot" :: held 1.389s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:46 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Created reservations ['a2642ebb-aa74-4c89-8722-b84f728f4f08', 'bd19d320-1f40-4eed-ad24-e4cccf8d2439', '13adc270-8968-4ed5-a0bc-11503ed6702a', '1e035963-5ec5-4638-b442-c3f8e3004789'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:46 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Delete snapshot completed successfully. Sep 17 17:22:46 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-ccb33b93-ddce-4d50-b4c4-4b114047798c tempest-ProjectMemberTests-72633776 None] Lock "cinder-20dc1e2f-0b0f-4aea-9480-82aaaeab6206-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-753fceba-7a71-4968-abd2-73e757b14963-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Lock "cinder-753fceba-7a71-4968-abd2-73e757b14963-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-753fceba-7a71-4968-abd2-73e757b14963" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:47 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-753fceba-7a71-4968-abd2-73e757b14963" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:47 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a01bfd9-c4b3-4e85-8f24-32e6d5fa717a]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:47 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:47 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 Sep 17 17:22:47 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:48 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963" returned: 0 in 0.348s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:48 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963 Sep 17 17:22:48 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:48 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-753fceba-7a71-4968-abd2-73e757b14963" returned: 0 in 0.249s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-753fceba-7a71-4968-abd2-73e757b14963" released by "delete_volume" :: held 0.656s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Created reservations ['409c36a9-6de5-40b1-832d-7405b571c306', 'e1eb9926-7f1d-45c9-a4a0-084227f5d4de', '9fa53c73-b601-423a-bb84-2ba1e31cc9c1', 'e4938015-88a1-430b-985c-6e5819d18d55'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:48 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:48 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:48 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.238s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:48 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Deleted volume successfully. Sep 17 17:22:48 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-134e6906-5735-4266-aea7-d07deb4b96cb tempest-ProjectMemberTests-72633776 None] Lock "cinder-753fceba-7a71-4968-abd2-73e757b14963-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (cef4c218-1f96-4a3c-88da-4a8376f80a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d640e5-dc1b-47f1-adb7-f9d194dfbd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d640e5-dc1b-47f1-adb7-f9d194dfbd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1639621499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e5a975-8732-4029-827a-10d7dbb47a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:49Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec130c5-111d-47ea-818a-e0115dad47b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec130c5-111d-47ea-818a-e0115dad47b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc72773-c16d-4f3f-b8d8-7222442c26a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc72773-c16d-4f3f-b8d8-7222442c26a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e5a975-8732-4029-827a-10d7dbb47a0d', 'volume_name': 'volume-12e5a975-8732-4029-827a-10d7dbb47a0d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd905927-3540-4954-a9c1-5248a39f9f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd905927-3540-4954-a9c1-5248a39f9f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b43dbec-1bd7-4077-8677-22735c1980ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:49 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Volume 12e5a975-8732-4029-827a-10d7dbb47a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e5a975-8732-4029-827a-10d7dbb47a0d', 'volume_size': 1} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1639621499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e5a975-8732-4029-827a-10d7dbb47a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d15ebebe5647ad8e21c1ee34970853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:22:49Z,use_quota=True,user_id='069f337c0df241deaf9108a210e2b76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Creating volume 12e5a975-8732-4029-827a-10d7dbb47a0d {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:22:49 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:49 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d 1073741824 Sep 17 17:22:49 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:49 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d 1073741824" returned: 0 in 0.419s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:49 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d Sep 17 17:22:49 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:49 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d" returned: 0 in 0.246s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b43dbec-1bd7-4077-8677-22735c1980ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e5a975-8732-4029-827a-10d7dbb47a0d', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:49 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7128c98-f6be-4ed5-81b9-9d462f16237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:22:50 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Volume volume-12e5a975-8732-4029-827a-10d7dbb47a0d (12e5a975-8732-4029-827a-10d7dbb47a0d): created successfully Sep 17 17:22:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7128c98-f6be-4ed5-81b9-9d462f16237f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:22:50 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Flow 'volume_create_manager' (cef4c218-1f96-4a3c-88da-4a8376f80a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:22:50 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-e14534ea-6339-432f-ae69-4a8160fdf220 tempest-ProjectMemberTests-72633776 None] Created volume successfully. Sep 17 17:22:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:50 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Creating offline snapshot 4c05628b-4054-4ad1-a833-7f76d50e5487 of volume 12e5a975-8732-4029-827a-10d7dbb47a0d {{(pid=85889) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 17:22:50 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bcdeb4-8971-4ace-8282-113165fecda3]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:50 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d Sep 17 17:22:50 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:50 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d" returned: 0 in 0.356s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:50 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 1G {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:50 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 1G Sep 17 17:22:50 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:51 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 1G" returned: 0 in 0.381s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e5a975-8732-4029-827a-10d7dbb47a0d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:51 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e5a975-8732-4029-827a-10d7dbb47a0d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 Sep 17 17:22:51 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:51 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12e5a975-8732-4029-827a-10d7dbb47a0d -F qcow2 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487" returned: 0 in 0.300s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:51 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 is being set with open permissions: ugo+rw Sep 17 17:22:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:51 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 Sep 17 17:22:51 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:51 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487" returned: 0 in 0.235s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:51 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.info Sep 17 17:22:51 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:51 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.info" returned: 0 in 0.244s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:51 devstack cinder-volume[85889]: WARNING cinder.volume.drivers.remotefs [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.info is being set with open permissions: ugo+rw Sep 17 17:22:51 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.info {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:51 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.info Sep 17 17:22:51 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:52 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.info" returned: 0 in 0.238s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:52 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-16eedc83-ccd6-4798-9efe-af99f7a5a19e tempest-ProjectMemberTests-72633776 None] Create snapshot completed successfully Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-4c05628b-4054-4ad1-a833-7f76d50e5487-delete_snapshot" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Lock "cinder-4c05628b-4054-4ad1-a833-7f76d50e5487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-12e5a975-8732-4029-827a-10d7dbb47a0d" by "delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-12e5a975-8732-4029-827a-10d7dbb47a0d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-4c05628b-4054-4ad1-a833-7f76d50e5487" by "_delete_snapshot" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-4c05628b-4054-4ad1-a833-7f76d50e5487" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Deleting offline snapshot 4c05628b-4054-4ad1-a833-7f76d50e5487 of volume 12e5a975-8732-4029-827a-10d7dbb47a0d {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] snapshot_file for this snap is: volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 {{(pid=85889) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9f5de5-a6e0-4d3d-90ac-91ed412ec0a5]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:52 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 Sep 17 17:22:52 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:52 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487" returned: 0 in 0.351s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:52 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12e5a975-8732-4029-827a-10d7dbb47a0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85889) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 17:22:53 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4516f3d8-538b-44d6-9bb7-409ba225f695]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:53 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d Sep 17 17:22:53 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:53 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d" returned: 0 in 0.351s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:53 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 Sep 17 17:22:53 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:53 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487" returned: 0 in 0.325s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:53 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487 Sep 17 17:22:53 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:53 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:53 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d.4c05628b-4054-4ad1-a833-7f76d50e5487" returned: 0 in 0.243s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-4c05628b-4054-4ad1-a833-7f76d50e5487" released by "_delete_snapshot" :: held 1.356s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:53 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-12e5a975-8732-4029-827a-10d7dbb47a0d" released by "delete_snapshot" :: held 1.377s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:54 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Created reservations ['70405395-fbe0-430d-92d1-914dc5f9f1b2', '2c7bc97c-ce79-447f-9cd1-be38fb6e4433', '24b3e40d-91c5-4626-a7a8-9ccba22b6ee4', '733cfac9-02cf-4e73-8ec7-faa9fd759cb8'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:54 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Delete snapshot completed successfully. Sep 17 17:22:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-a4a09507-132f-4b0c-b287-f95f19e7ca2d tempest-ProjectMemberTests-72633776 None] Lock "cinder-4c05628b-4054-4ad1-a833-7f76d50e5487-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-12e5a975-8732-4029-827a-10d7dbb47a0d-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Lock "cinder-12e5a975-8732-4029-827a-10d7dbb47a0d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Acquiring lock "cinder-quobyte-12e5a975-8732-4029-827a-10d7dbb47a0d" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:22:54 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-12e5a975-8732-4029-827a-10d7dbb47a0d" acquired by "delete_volume" :: waited 0.014s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:22:54 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3225f3c3-a414-47ce-b09b-8c43d85e7a8d]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:22:54 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:54 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d Sep 17 17:22:54 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:55 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d" returned: 0 in 0.355s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:55 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d Sep 17 17:22:55 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:55 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-12e5a975-8732-4029-827a-10d7dbb47a0d" returned: 0 in 0.248s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Lock "cinder-quobyte-12e5a975-8732-4029-827a-10d7dbb47a0d" released by "delete_volume" :: held 0.661s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Created reservations ['812daed2-6a9f-4c42-a887-78370567a9d2', '14dfd6ff-a5de-48ae-9cde-7d68c95abd8b', '679d7da5-79f3-4abb-9a86-216228cc8868', '15cc5d71-ce76-4e31-af5c-3e8fd1385b58'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:22:55 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:22:55 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:22:55 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.247s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:22:55 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Deleted volume successfully. Sep 17 17:22:55 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-6f10f1d2-5966-41a3-a694-cebb5006e17c tempest-ProjectMemberTests-72633776 None] Lock "cinder-12e5a975-8732-4029-827a-10d7dbb47a0d-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Flow 'volume_create_manager' (3f7f68eb-4933-463a-a23d-f15940a9b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699507e8-ee55-498b-ad8b-cce11ae63d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699507e8-ee55-498b-ad8b-cce11ae63d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1885185679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2948b993-090e-4b0a-bb57-392826053b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab33b77d5704435ab15b8ce98533957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:23:06Z,use_quota=True,user_id='e4922818b7224da994fde46d01c6d0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf15bb7f-5df9-40ce-8f44-bd526e10b137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf15bb7f-5df9-40ce-8f44-bd526e10b137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed785a50-25f2-443a-ab64-7fe33a040f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed785a50-25f2-443a-ab64-7fe33a040f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2948b993-090e-4b0a-bb57-392826053b0f', 'volume_name': 'volume-2948b993-090e-4b0a-bb57-392826053b0f', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb3fa2c-e1f6-459c-8950-74b9f871be37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb3fa2c-e1f6-459c-8950-74b9f871be37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409e2b2d-1770-4129-9872-1653e93d6872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:05 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Volume 2948b993-090e-4b0a-bb57-392826053b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2948b993-090e-4b0a-bb57-392826053b0f', 'volume_size': 1} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1885185679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2948b993-090e-4b0a-bb57-392826053b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab33b77d5704435ab15b8ce98533957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:23:06Z,use_quota=True,user_id='e4922818b7224da994fde46d01c6d0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Creating volume 2948b993-090e-4b0a-bb57-392826053b0f {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:23:05 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:23:05 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:06 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f 1073741824 Sep 17 17:23:06 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:06 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f 1073741824" returned: 0 in 0.407s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:06 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f Sep 17 17:23:06 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:06 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f" returned: 0 in 0.243s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:06 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:23:06 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:23:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409e2b2d-1770-4129-9872-1653e93d6872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2948b993-090e-4b0a-bb57-392826053b0f', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6aa515-cb05-4727-992c-24924bb62284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:06 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Volume volume-2948b993-090e-4b0a-bb57-392826053b0f (2948b993-090e-4b0a-bb57-392826053b0f): created successfully Sep 17 17:23:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6aa515-cb05-4727-992c-24924bb62284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:06 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Flow 'volume_create_manager' (3f7f68eb-4933-463a-a23d-f15940a9b69c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:23:06 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a8171ce2-ccd9-42b4-9fd7-1b40ee070da0 tempest-ProjectReaderTests-2065993390 None] Created volume successfully. Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Acquiring lock "cinder-2948b993-090e-4b0a-bb57-392826053b0f-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Lock "cinder-2948b993-090e-4b0a-bb57-392826053b0f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Acquiring lock "cinder-quobyte-2948b993-090e-4b0a-bb57-392826053b0f" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Lock "cinder-quobyte-2948b993-090e-4b0a-bb57-392826053b0f" acquired by "delete_volume" :: waited 0.015s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d2a2b3-80bf-4cb1-9bea-81f36070cc8c]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:07 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f Sep 17 17:23:07 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:07 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f" returned: 0 in 0.354s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:07 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f Sep 17 17:23:07 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:07 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-2948b993-090e-4b0a-bb57-392826053b0f" returned: 0 in 0.239s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Lock "cinder-quobyte-2948b993-090e-4b0a-bb57-392826053b0f" released by "delete_volume" :: held 0.636s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Created reservations ['66d41d4c-f083-4a52-8922-89b3ce15720a', '252be586-5941-4d0c-a804-d71e2f457a0a', '48845a3d-2349-44c0-863c-2351a7568203', 'c6d9faa7-a898-4c3e-985e-e0830133de36'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:23:07 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:07 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:23:07 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:08 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.239s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:23:08 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Deleted volume successfully. Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-fd10be0a-9ee3-4a11-9e5d-8249f48d3b40 tempest-ProjectReaderTests-2065993390 None] Lock "cinder-2948b993-090e-4b0a-bb57-392826053b0f-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85889) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Flow 'volume_create_manager' (22ff2f63-bbba-4d30-aa82-33b178b72667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064e0de4-d5da-4767-9261-7f8e2e76ef01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064e0de4-d5da-4767-9261-7f8e2e76ef01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1251708107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d13479-b5ff-45a9-b5fa-329a57bf29b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab33b77d5704435ab15b8ce98533957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:23:09Z,use_quota=True,user_id='e4922818b7224da994fde46d01c6d0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bb72e9-f239-435c-b390-55c6a1e6d63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bb72e9-f239-435c-b390-55c6a1e6d63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f2ec4c-de05-4a33-bb64-8fa4aeee74bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f2ec4c-de05-4a33-bb64-8fa4aeee74bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d13479-b5ff-45a9-b5fa-329a57bf29b1', 'volume_name': 'volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4e7248-f759-481d-815f-dab42a9a609d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4e7248-f759-481d-815f-dab42a9a609d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b4a4cb-1e57-4dc1-b92b-1b0b14f5f1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:08 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Volume 88d13479-b5ff-45a9-b5fa-329a57bf29b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1', 'volume_size': 1} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T15:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1251708107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d13479-b5ff-45a9-b5fa-329a57bf29b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab33b77d5704435ab15b8ce98533957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T15:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T15:23:09Z,use_quota=True,user_id='e4922818b7224da994fde46d01c6d0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969894be-83f3-46e3-bd45-d6b80b1eee71),volume_type_id=969894be-83f3-46e3-bd45-d6b80b1eee71)}" {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.remotefs [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Creating volume 88d13479-b5ff-45a9-b5fa-329a57bf29b1 {{(pid=85889) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Selected osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 as target Quobyte volume. {{(pid=85889) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 17:23:08 devstack cinder-volume[85889]: INFO cinder.volume.drivers.remotefs [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] casted to osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189 Sep 17 17:23:08 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1 1073741824 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:08 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1 1073741824 Sep 17 17:23:08 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:09 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1 1073741824" returned: 0 in 0.396s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:09 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1 Sep 17 17:23:09 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:09 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1" returned: 0 in 0.245s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'} {{(pid=85889) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b4a4cb-1e57-4dc1-b92b-1b0b14f5f1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1', 'volume_size': 1}' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa51a182-8b43-4ba5-b412-d140e1eb56f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 17:23:09 devstack cinder-volume[85889]: INFO cinder.volume.flows.manager.create_volume [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Volume volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1 (88d13479-b5ff-45a9-b5fa-329a57bf29b1): created successfully Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa51a182-8b43-4ba5-b412-d140e1eb56f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85889) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Flow 'volume_create_manager' (22ff2f63-bbba-4d30-aa82-33b178b72667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85889) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 17:23:09 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-a8927fd4-c8cb-4068-9522-ea8591156281 tempest-ProjectReaderTests-2065993390 None] Created volume successfully. Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Acquiring lock "cinder-88d13479-b5ff-45a9-b5fa-329a57bf29b1-delete_volume" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Lock "cinder-88d13479-b5ff-45a9-b5fa-329a57bf29b1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Acquiring lock "cinder-quobyte-88d13479-b5ff-45a9-b5fa-329a57bf29b1" by "delete_volume" {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Lock "cinder-quobyte-88d13479-b5ff-45a9-b5fa-329a57bf29b1" acquired by "delete_volume" :: waited 0.013s {{(pid=85889) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc31f7b3-77e0-49e9-88ff-660947219d73]: (4, 'qcow2') {{(pid=87523) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 17:23:09 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:09 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1 Sep 17 17:23:09 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:10 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1" returned: 0 in 0.350s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:10 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1 Sep 17 17:23:10 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:10 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420/volume-88d13479-b5ff-45a9-b5fa-329a57bf29b1" returned: 0 in 0.250s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Lock "cinder-quobyte-88d13479-b5ff-45a9-b5fa-329a57bf29b1" released by "delete_volume" :: held 0.637s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG cinder.quota [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Created reservations ['944e3a47-0703-4bef-ba13-c248b5caa191', '1efbc0d2-26f1-46ba-bcce-4f1c4eaa5523', '651821eb-bedf-442b-aa9b-ecb3f2de58a1', '929a3de0-6e52-4171-ad34-50b56a765f36'] {{(pid=85889) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:10 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:23:10 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:10 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.239s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:23:10 devstack cinder-volume[85889]: INFO cinder.volume.manager [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Deleted volume successfully. Sep 17 17:23:10 devstack cinder-volume[85889]: DEBUG cinder.coordination [None req-49cfbc76-9a31-42fb-87b4-ca8aa8f218f2 tempest-ProjectReaderTests-2065993390 None] Lock "cinder-88d13479-b5ff-45a9-b5fa-329a57bf29b1-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=85889) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 17:23:20 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=141,cinder:SELECT=84,cinder:INSERT=33,cinder:DELETE=13 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:23:20 devstack cinder-volume[85889]: DEBUG dbcounter [-] [85889] Writing DB stats cinder:UPDATE=122,cinder:DELETE=9,cinder:SELECT=100,cinder:INSERT=34 {{(pid=85889) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189': None} {{(pid=85889) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG cinder.volume.drivers.quobyte [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-68a8243b-906a-4d8a-99e3-61cb1c284189'] {{(pid=85889) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.lockutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85889) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 17:23:22 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420 Sep 17 17:23:22 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 17:23:22 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG oslo_concurrency.processutils [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68e39405e8a30bb0e6e4bf4677952420" returned: 0 in 0.240s {{(pid=85889) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG cinder.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Notifying Schedulers of capabilities ... {{(pid=85889) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG oslo_service.periodic_task [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] Running periodic task VolumeManager._thread_info {{(pid=85889) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread count: 28 {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 17:23:22 devstack cinder-volume[85889]: DEBUG cinder.volume.manager [None req-9ba68827-76e6-491d-a39b-5a65428d2233 None None] thread info: [<_MainThread(MainThread, started 128659836051584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85889) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}